Kong DevopsSpeakeasy at Kong Summit 2022, 29 Sep 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: #DevOpsSpeakeasy at #kongsummit22 with Madan Thangavelu (@madanthangavelu)

Description

Restream helps you multistream & reach your audience, wherever they are.

A

We have Morgan here with me. Welcome to those pick easy.

B

A

You and Madam is also a speaker at this conference and you already delivered your talk right.

B

A

All right so tell us a little bit what what did you talk about you're with Uber, so huge company, huge I.T, uh billions of requests on every like millisecond? And what's not what did you speak about? Yeah.

B

So today we really nail down on reliability as a core construct and how API gateways connect with the reliability, because, if you think about it, API Gateway is sitting on top of your entire infrastructure and a large company like uber. We are at you, know, 2500 API, so pretty large asset, and it gives you the single choke point to see what's going in and out, and that unique Advantage helps a lot in reliability. So today's talk was a lot about all the things you could build in a gateway to enable reliability and improve product reliability.

B

A

Right, so let me let me understand, so we have this API Gateway, which is a control point that kind of seats in the entrance of your microservices. How does it help make the microservices more reliable.

B

Okay, that's a great question: it's. It does not directly help with reliability, but it's about the end product reliability. So, for example, we oh we can do about the Gateway. Is it can be the point which redirects traffic from being odd, so every in, if it's from a particular City and that city is down because there's bad code in that zone from the Gateway, you can reassign that to a different Data Center and so as an operator who's kind of responding to that incident.

B

Your goal using the Gateway is to quickly mitigate an issue and an outage for that City. So it's it's more than.

A

So it helps with a lot of balance right right again,.

A

The traffic to go into a vulnerable area that you want to protect from the traffic or from a certain amount of traffic in a certain period of time, yeah.

B

Absolutely- and the thing to remember is like the large companies like uber, we operate at 10, 000 cities and we end up sharding our traffic out so that you know.

B

Exactly around a particular City to specific data, centers or zones. So if there's bad code in one zone, you can redirect that to another.

A

With the overall system of the reliability, but who watches the Watchman? Okay,.

B

A

Do you make sure that the Gateway itself is reliable.

B

The game with reliability is like it's it's a lot of like metrics and observability that goes and isolation that needs to be built in because, ultimately, you know, the Gateway core is a very fundamental, very clear-cut, understood.

B

A

Where people's.

B

Arbitrary code goes in so the Gateway core is usually in a very, very guarded.

B

Fails the core itself does not fail, which means your API might fail, because you're doing something wrong with one of the microservice.

B

It shouldn't be affected.

A

That makes sense and and how this does.

A

B

A lot of the talk today was specifically about things you can build as extensions on a Gateway of your choice and Kong definitely allows you to provide. You know the plug-in as a construct to add these functionalities. So I talked a lot about uh the kind of headers you need to pass down to Downstream microservices like the tier and the importance of the API, the endpoint name or the tenancy, which is the test. Traffic production traffic is a. Is it a load? You know low test traffic and things like that.

B

So building these constructs into your gateway with extensions, allows you to then uh kind of push that down to the services.

A

And I guess the architecture of the Gateway itself protects the bed code of the plugins, yes from affecting the reliability of the Gateway itself.

B

Absolutely yeah that absolutely needs to be there, because uh you know your your bad neighbor is about is a complex thing to achieve, and that's at the plug-in level, and that's also the higher order. Api level and uh both of them needs to be taken care of.

A

Yeah that makes perfect sense. It's a fascinating topic, I must say, and I would love to learn more about how con uh guarantees the reliability of their Gateway, but either sandboxing the plugins or probably there are other techniques and I think Rick. If you are listening to that from its request for a Content, Builders episode and I guess inviting modern might be a good idea. I put you all here on the spot. This is what I.

B

A

um Very much for coming and that's that's fascinating, to learn. Awesome pleasure.

B

Talking to you all right, thank.

A

B

Bye, well, you you made it uh really easy.