Cloud Native Computing Foundation / Open Observability Day NA 2022

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Closing Remarks - Anurag Gupta, Program Committee Member

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Opening Remarks + Project Updates - Bartek Płotka, Open Observability Day Program Co-Chair

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Why Large-Scale Observability Needs Graph - Richard Benwell, SquaredUp

How do we make use of the increasing volume of observability data that we collect? Observability was inspired by control theory, but current observability solutions are missing a key element of that theory: the system model. We can’t understand the state of the system, or ‘answer unknown unknowns’ if we don’t know how the system works. We’re drowning in data but starved of answers. Graphs (think social network graph, not line graph) allow to understand how things are connected, and a new trend of graph databases including neo4j, AWS Neptune and Azure Cosmos have taken graph technology mainstream. This talk looks at early signs of how the observability community are beginning to leverage graph concepts – including Jaeger service graph, Backstage service catalog and eBay's Groot (root cause analysis) tool – and some of the opportunities and challenges around how observability data can reveal more answers with graph.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Adopting Open Telemetry Collector @ eBay - Swapping Engines Mid Flight - Vijay Samuel , eBay

The Open Telemetry initiative is providing observability practitioners a vendor neutral and an open standard by which applications can ship telemetry data into observability platforms. eBay is a well documented adopter of Elastic Beats. eBay has been an extensive contributor to the Beats project and contributed its Kubernetes autodiscover module which can dynamically monitor pods on Kubernetes clusters. However, with the rest of the observability ecosystem converging onto Open Telemetry, we felt that it is essential for us to adopt the same. This presentation focuses on: * scale problems seen in large Kubernetes installations * benefits of using annotation based discovery at scale * our journey of replacing Metricbeat with Open Telemetry Collector without impacting metric collection * bridging critical gaps such as: * dynamic configuration reloading * semantic differences between Prometheus receiver and stock Prometheus * challenges faced in ensuring data parity post migration and solutions

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Building Observability Pipeline with Fluent-Bit - Chao Xu, LinkedIn

This talk will discuss LinkedIn's efforts and experiences to build up the observability pipelines with the help of open source standards and tools, specifically OTEL and fluent-bit. Starting with tracing, we adopted the industry standard OpenTelemetry (OTEL), including both tracing schema and SDKs. This gave us a chance to leverage the already existing and supported tools and components. We also decided to introduce the transport agent to hide all the details of accessing the data backend from the application, therefore get the much needed multi-language support. (Not) surprisingly, Fluent-bit was chosen as our transportation agent, as opposed to the OTEL agent already provided in the OTEL SDK. This decision was made mainly based on the following considerations: - Kafka is our preferred and chosen centralized data collector - Log streaming is the required functionality. - Resource efficiency and performance. We also enhanced fluent-bit in the following ways: - OTEL transport agent with protobuf support - Metrics emission for Monitoring - Tag management and enhancement We'd be happy to contribute these enhancements back to the open source community in the future.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Confidence with Chaos for Your Kubernetes Observability - Michael Friedrich, GitLab

The Kubernetes observability stack is deployed with Prometheus, and dashboards provide many interesting insights. What’s next? Everything is overwhelming and your teams are drowning in alerts. Alerts and Service Level Objectives (SLO) require team discussions and adjuments, and the dashboards could benefit from more fine granular details. Documentation and action items for your SRE and DevOps teams are needed too. Simulate a production incident to see whether SLOs are met, or alerts are fired. Is there a way to observe the deployed application, and see if it breaks from chaos? Join this talk to dive into ops and dev stories with practical insights into Kubernetes metrics, Prometheus alerting, chaos engineering with Chaos Mesh, OpenTelemetry app instrumentation, and hear about production incidents with failed SLOs. Gain confidence with chaos as an SRE, and as a developer seeing the value in Observability. Welcome to day 2 DevOps.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Keynote: Distributed Tracing - The Struggle is Real - Ian Smith, Chronosphere

In 2010, Google published a paper describing how they implemented distributed tracing internally. 12 years later, we’ve made limited progress on widespread implementation of this technology, despite near universal agreement that distributed tracing has the potential to solve many of the challenges brought on by cloud native. Despite our best efforts, few companies have fully implemented distributed tracing and even fewer engineering organizations utilize it with confidence. In this session, we’ll explore where organizations are getting stuck with distributed tracing and how they can overcome these obstacles. To drive broader adoption of distributed tracing, we need a new approach.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Keynote: Observability Simplified - Eduardo Silva, Calyptia

Observability is a journey that brings excellent values, at a current cost of an operational complexity associated with it, until now.

In this presentation, we will go through our lessons in the logging space by building the Fluent Bit project and how extending the ecosystem to support Metrics, and Traces has helped shape a simplified user observability experience.

Calyptia, one of the primary sponsors of Fluent Bit, is redefining the observability experience by removing the operational burden; come to learn more about how you can reduce your "time to observe" and "costs" in a vendor-neutral way.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Leveraging OpenTelemetry for Your Prometheus Pipeline - Goutham Veeramachaneni, Grafana Labs

OpenTelemetry metrics are now GA and it promises to be fully compatible with Prometheus! People are looking to use OTel to migrate from their existing monitoring system to Prometheus or use one of the many data transformation capabilities of the Collector. But trying to use it with Prometheus throws a lot of questions: 1. What are the advantages of using OTel in my Prometheus pipeline? 2. Which of the 3 Prometheus receivers and 3 Prometheus exporters do I use, and when to use which? 3. Can I replace Prometheus or the agent with the OTel Collector? 4. Can I use Prometheus instrumented applications with OTel and vice-versa? When does it make sense to rewrite your instrumentation? 5. What is the migration path I could use? Come attend this talk by Goutham Veeramachaneni for answers to the above questions and understand the different components inside OTel Metrics and how they interact with the Prometheus eco-system. The talk will dive into the common scenarios and pipelines, the gotchas and when and how to migrate from Prometheus to OTel for metrics and vice-versa.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Achieving Unified Observability for Cloud and Edge with FluentBit - Benjamin Huo, QingCloud Technologies

With the rising of cloud native edge computing technologies, more and more organizations start to use Kubernetes to manage edge resources and workloads with the help of edge frameworks. Some of these edge frameworks like KubeEdge manage edge nodes as part of a cloud K8s cluster which brings challenges to users to manage edge nodes and edge applications. Observability is one of these challenges, for example: 1. Monitor and alert edge nodes and applications in the same way as cloud 2. Collect and search edge nodes and applications logs in the same way as cloud In this talk, Fluent Operator maintainers will discuss: 1. Use Fluent Operator to manage FluentBit for both cloud and edge environments. 2. Use FluentBit to collect edge nodes and applications logs and forward them to the cloud side. 3. Use FluentBit to collect edge nodes and applications metrics and remote write it to a Prometheus long-term storage in the cloud. 4. Manage logs and metrics in a central place for both edge and cloud.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Making Sense of Observability with Auto-Discovered Security Policies - Ankur Kothiwal, Accuknox

It is common to analyze network and system logs for generating security policies, but the manual process is inefficient and has a high chance of missing important logs. Discovery Engine is an open-source policy recommendation system, which can act as a plug-in for K8s environments that discovers network and system policies based on the logs collected from the various container network interfaces (CNIs). The engine leverages aggregation techniques to reduce the number of policies discovered, uses pod labels for rules specification, and handles the discovery across multiple dimensions (networks, systems). This talk will help in providing an insight into how the auto policy discovery tool works, its use-cases, and the requirement for an automated runtime policy generating engine in the changing cloud-security environment.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Managing OpenTelemetry Through the OpAMP Protocol - Mike Kelly, observIQ

Managing thousands of data collection Agents across just as many servers can overwhelm DevOps teams. Open Agent Management Protocol (OpAMP) is a new network protocol from the OpenTelemetry Project that enables remote management of OpenTelemetry collectors, allowing them to report their status to and receive configuration from a Server and to receive agent package updates from the server. This eliminates the need to create new custom distributions and redeploy, drastically simplifying Agent management. OpAMP is also vendor-agnostic, so the Server can remotely monitor and manage a fleet of different Agents that implement OpAMP, including a fleet of mixed agents from different vendors. In this talk, Mike will detail the OpAMP specification and future possibilities being discussed by the community.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: OTel Me How to Build a Data Pipeline for Observability - Daniel Kim & Reese Lee, New Relic

Observability boils down to a data problem. To gain observability, we need to collect signals from many different data sources, frameworks and programming languages. It is important to turn heterogeneous data across so many different signals into actionable insights through a framework like OpenTelemetry, an open source standard enabling us to collect, process, and export telemetry data. In this session, we will discuss the complexities that come with handling telemetry data from distributed systems as they scale. Next, we will show you how to build an observability data pipeline using the OpenTelemetry collector and open source plugins that can perform a wide variety of data processing, such as injecting infrastructure metadata into traces and metrics, implementing tail-based sampling, and exporting data to any backend via OTLP. Finally, we will share some of the challenges with running the collector, so that you can take them into account as you build out your own observability pipeline with OpenTelemetry.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: What Can eBPF Actually do for Modern-day Observability? - Ori Shussman, Groundcover

This talk is all about exposing how the magic of eBPF can be used to achieve full observability in complex edge cases, through the lens of a real-life gRPC monitoring case study. In the era of ever-growing observability data, existing monitoring solutions are faced with new problems, often deeming them impractical. We will deep dive into the hardships of monitoring gRPC and other compressed or encrypted protocols and show how gRPC monitoring has undergone a revolution thanks to the integration of eBPF

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Opening the Door to Observability - Libby Meren, Crowdstrike

Almost every organization is somewhere along the path to observability: from just getting started to having a sophisticated observability mindset. Whether you’re writing the code, deploying it to production, supporting users, or ensuring that their payment has hit the books in time, observability is fundamental for everyone, everywhere: it's about what you're trying to deliver to your end user. You know it's important, but how do you build a case for observability and convince leadership to invest? In this talk we give you a grounding on how observability impacts and empowers every part of the business, and then share insights to help you define your strategy. We discuss the importance of open observability tools, along with why this should be key to your strategy. We share learnings from our experience observing teams making this transition, and leave you equipped to take charge of advocating for the necessary investment.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

The Amazing Trace: Enhancing Distributed WebAssembly With OTEL- Brooks Townsend, Cosmonic

Have you ever looked back on a feature and wondered how you survived without it in the first place? This is exactly what OTEL did for wasmCloud, a CNCF sandbox application runtime for WebAssembly workloads on the server. As a platform focused on distributed computing, wasmCloud supports running applications on any platform, any cloud, and any edge. In such a distributed system it could be difficult to track down the source of issues, bottlenecks, and even where requests were even going in the first place. This talk focuses on the massive improvements wasmCloud saw after implementing tracing across its platform components. Aimed at reducing complexity for the developer, tracing is implemented at all stages behind-the-scenes and only requires an exporter to flip the observability switch.

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io​. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

“Are These Things Talking to Each Other?” - Observing Kubernetes Networking with Cilium, Hubble and Grafana - Anna Kapuścińska, Isovalent

“Are they even talking to each other”? - asked almost every engineer on the planet when debugging their system. Although the question is being asked forever, the answer isn’t always easy. As the complexity of our systems grows, networking becomes more and more a magic glue: it's hard to understand and even harder to debug. Good observability helps in both understanding and debugging what happens. Nowadays more and more people are looking into eBPF as a solution for networking and observability. That’s what the Cilium project provides: eBPF-based networking, with a visibility layer - Hubble. At the same time, observability in the cloud native world is commonly achieved with Prometheus and Grafana dashboards. We will connect these technologies. Using Hubble metrics, we will visualize how applications talk to each other in a Kubernetes environment, famous for its complex networking. In a real-world scenario, we will discover a mysterious communication problem. It won’t scare us though. Equipped with open source tools, we will quickly debug the system and uncover the underlying issue.