Cloud Native Computing Foundation / EnvoyCon 2018 (Seattle)

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Bridging the gap between on-prem and cloud: a story about Envoy + a hybrid boundary - Tristan J Blease, Groupon + Michael Chang, Groupon

Groupon operates regional data centers where our product and platform engineering teams deploy and manage over 600 microservices on-premise. This year marks the start of our journey to migrate these microservices to the cloud where we expect them to run alongside our existing on-premise deployments.

Like many others on similar journeys, we have an important problem to solve: how do we enable traffic to cross our new hybrid boundaries?

From the previous usage, we know that Envoy can play a pivotal role in solving this problem, but what other components would be needed? How can we create a fully automated system that deeply integrates with our on-premise environments, which currently lack automation in key places? For this project to be successful, we have to answer these questions and more.

Join us to learn how Groupon is answering these questions and to learn how we are rolling out a fully automated system of edge proxies leveraging Envoy and other technologies for traffic management.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Building + operating a service mesh at a mid-size company - Taiki Ono, Cookpad Inc.

Service meshes are not only for big companies. It works for intermediate-sized companies as well. We, Cookpad, are a mid-sized company having 200+ developers, 10+ teams, 90M monthly users.

We are building our own service mesh using Envoy proxy for our microservices. And, we are getting the benefit of service mesh. The biggest benefit is observability: we can easily know how our microservices are working by looking into fine-grained metrics per upstream service. The second benefit is process model independency: we now have the outbound proxy for every app which controls retries, timeouts, circuit breaking and load balancing.

I will share the knowledge and techniques through our case: how did we build, and our architecture and toolchains. We are using AWS ECS as a container orchestration, and our service mesh is built on it.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Closing Remarks - Matt Klein, Lyft
Join us for KubeCon + CloudNativeCon in Shanghai June 24 - 26, and San Diego November 18 - 21! Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Envoy at Square - Michael Puncel + Snow Petteren, Square, Inc.

This talk will cover:
- motivation for Square's move to Envoy
- design considerations that went into our implementation and rollout process
- particulars about our Envoy setup in our infrastructure (unix sockets, no TLS in apps, etc)
- how we supported legacy client behavior in Envoy
- how we streamlined the migration process to minimize interruption to app engineer road maps

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Hardening Envoy - Alyssa Wilk, Google

As Envoy picks up momentum both as a standalone proxy and the signature proxy of CNCF it becomes more and more important to improve Envoy's reliability and stability without reducing developer momentum.

This talk will cover some of the recent enhancements made both to the Envoy binary to improve reliability and decrease attack surface, work done to fuzz both Envoy and Envoy's third party dependencies to reduce the likelihood of queries of death sneaking into the code base, and committed and planned changes to the Envoy test framework to improve end to end coverage and better test production-like scenarios.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

How to DDOS yourself with Envoy (and other tales of migration horror) - Ben Plotnick, Yelp + John Billings, Yelp

Yelp has been working with service meshes since the introduction of SmartStack in 2014. After reaching the limits of the SmartStack featureset, we were eager to upgrade to Envoy. With years of experience operating a service mesh at scale, we figured that the migration would be a walk in the park… It turns out the park is larger than we thought.

In this session, we’ll discuss our experience migrating Yelp’s hundreds of services to using Envoy, the migration challenges we faced, and the solutions that we’ve come up with including:

* Transparently moving clients between SmartStack and Envoy using client library feature toggles
* Transforming Envoy’s grpc access log messages to HAProxy-formatted syslog messages in order to harness our existing log processing pipeline
* Using docker-based acceptance testing to confidently push control plane changes directly to production
* How to avoid DDOSing yourself with Envoy’s health checks

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Lightning Talk: Debugging microservices applications with Envoy + Squash - Idit Levine, Solo.io

The mainstreaming of containerization and microservices is raising a critical question by both developers and operators: how do we debug all this?

Debugging microservices applications is a difficult task. The state of the application is spread across multiple microservices, and it is hard to get a holistic view of the state of the application. To meet this challenge we developed Squash, the microservices debugger. Squash integrates with Envoy to attach a debugger to any application in the service mesh.

In this talk, we will describe the Envoy filters we wrote to integrate with Squash to facilitate distributed debugging.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Lightning Talk: Extending Envoy with Go - Thomas Graf, Covalent

Envoy has become a popular proxy in the cloud native landscape thanks to its robustness, stability, efficiency and community. What if we could extend Envoy filters and parsers using Go. This talk introduces the new Go based extension framework for Envoy that allows to extend Envoy with customized filters, logic and protocol parsers written in Go without requiring to understand the entire C++ codebase. We will walk through how everyone in the community can write a Go extension to Envoy to add additional protocol parsers or filtering logic and discuss how this allows to implement a fully distributed servicemesh.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Lightning Talk: How to deploy mutually authenticated TLS without ruining everything - Spike Curtis, Tigera

TLS with mandatory mutual authentication is the gold standard for communication in distributed applications and forms the backbone of a Zero Trust Network. Envoy can do it for you with no application code changes, but if you just “turn it on” in a live production cluster you’ll quickly find you have a major disruption on your hand.

In this presentation, Spike will explain and demonstrate how to take a production cluster from a completely unencrypted to fully secured without dropping traffic. The demonstration will use Istio, but Spike will explain conceptually and cover the Envoy config changes being made in each step so the techniques can be applied to any Envoy service mesh.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Lightning Talk: Integrating Envoy with DPDK-based virtual networks - Raja Sivaramakrishnan, Voltera Edge Services

This talk will focus on the work we have done at Volterra to
integrate Envoy with a user space network stack built on top
of DPDK (Data Plane Developer Kit) with support for load
balancing across multiple virtual networks.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Lightning Talk: It’s 10pm, do you know what your proxy is doing? Understanding the xDS Protocol! - Isaac Diamond, Stripe

The Envoy xDS protocol forms the backbone of the Envoy v2 discovery APIs but understanding the the details can be pretty challenging. Remembering the differences between the CDS, LDS, EDS, and RDS is tough, let alone figuring out how they work under the hood! The documentation for the xDS protocol can be hard to understand for beginners and there are a few subtleties to consider while building an implementation. This talk explores the design of the xDS protocol through the lens of our experience building a management server implementation. Over the course of this talk we’ll cover the basics of the lifecycle of xDS gRPC connections and the way configuration updates are delivered to Envoy. Attendees will hopefully come away with a clearer understanding of the internals of the protocol that underlies Isito and Envoy’s Go Control Plane and will be equipped with an understanding of where to look to start building xDS implementations themselves!

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Lightning Talk: Who is Envoy - Harvey Tuch, Google

An analysis of Envoy source code, contributors, history and evolution, providing insight into the trust relationships in the community, who is developing, reviewing and approving changes. What the Envoy developer dynamic looks like, a quantitative state-of-the-union.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Running Envoy as an Edge Proxy - Bala Madhaven, eBay + Qiu Yu, eBay

At eBay we run Envoy as our Edge proxy in PoPs (Point of Presence) across the globe. In this talk, while we walk through eBay's journey of running Envoy at all eBay POP's, we will discuss the following key aspects:
Architecture overview of eBay Edge Proxy
Managing Envoy in Kubernetes.
Consistently developing the entire stack across all edges of Helm.
Building a metrics and access log based pipelines for better visibility using Prometheus and ELK stacks.
Migrating Hardware LB configurations to Envoy and validating them using automation tools.
Integrating Envoy at ATS (Apache Traffic Server) to enable dynamic caching at eBay.
In this talk, we will touch on the challenges and the solutions that were applied while we completely moved all eBay mobile traffic from Hardware LB to Envoy.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Running Envoy at the Edge - Derek Argueta, Pinterest

Migrating infrastructure can be hard, but we want to help you accomplish it. In this talk, we will walk you through the story of how we operationalized and deployed Envoy as the edge load balancer for Pinterest, and all the fun learnings along the way. We will demonstrate how we leverage Envoy's powerful stats subsystem to build confidence in the load balancing tier and aid debugging for all engineers. We will also discuss some of the upstream contributions we have made and why we needed them, as well as cover the custom extensions we wrote to accomplish on-par feature parity with our previous load balancing system. You will learn how we debug, profile, and develop on Envoy. Lastly, we will lay out the vision for Envoy in the service mesh use-case at Pinterest and provide information about how we plan to get there.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Use Envoy + Knative to auto scale Java RPC micro service - Andy Shi, Alibaba

Envoy and Istio have greatly enhanced Observability of micro-services. But are we stopping at observing and reporting? How about reacting based on the metrics collected?

Kubernets and other orchestration systems have already offered auto-scaling capability. Is there a way to incorporate the matrics into the mechanism?

Dubbo RPC is an Open Source Java RPC framework. Now that Envoy has supported Dubbo protocol, the metric generated by Dubbo can be fed into the Prometheus. With that, we can gain many insights that outside systems like Kubernets simply cannot access.

In this talk, we'll talk about how we integrated Dubbo protocol with Envoy and feed the metric into Prometheus. We will show a live demo of a feedback loop where Prometheus triggers an alert to a Knative Serverless function that will auto-scale the pods.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Using Envoy for data aware traffic routing in Azure Service Fabric - Vaclav Turecek, Microsoft

Learn how Envoy is the key component in solving Service Fabric's unique data-aware traffic routing challenges. With co-located compute and state, service communication needs to be aware of data partitioning and replica placement in addition to the ingress, discovery, and networking challenges typically found in distributed applications and cloud-native architectures.

We'll show you how Envoy is being integrated into Service Fabric to abstract away the complexities of traffic routing and provide a language and platform agnostic service communication layer. As a bonus, we'll also show you how we made Envoy work on Windows.

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Welcome + Introduction - Matt Klein, Lyft