Kong Kong Builders Livestream Recordings, 10 Nov 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Kong Ingress Controller and Knative | #KongBuilders – November 10th

Description

In this #KongBuilders session, Viktor Gamov, developer advocate with Kong, will walk you through the setup and deployment of a serverless application (service).
For services we will use the open-source Knative project together with Kong on Kubernetes.

A

A

Hey: hey, hey, hey, hey! uh Welcome! Welcome, I'm checking my audio signal. It looks fine. Welcome, welcome to clunk youtube channel. um It is wednesday it is wednesday, so we doing today, uh kong builders, um if you're watching us live, which you should because the most experience from the show you can get if you're watching us live and you are participating in the stream and you asking some questions- maybe even get some answers.

A

Please. My friends write down in the comments how you can hear me or if you can hear me at all, because I see right now- around six people are watching uh two of them. Probably it's my parents as always uh they're watching my live streams, um write down any comments. Where are you coming from and uh what is your name and what are you drinking today?

A

uh This is the koank youtube channel, um some of us. Some of you might watch this in other places like linkedin last time, linkedin didn't work out for some reasons. I need to check if it actually works this time.

A

Let's see if uh people can watch us there as well um like, let me quickly check no waiting for broadcast. So something is not right.

A

It's supposed to be supposed to be supposed to be checking in. Why I don't see why I don't see why I don't see people watching us on youtube. Also, let me quickly check if, if we are live in, let me go to the um to um to studio okay um next time I don't know like. I don't know why this is happening with the uh with the linkedin fella.

A

uh Maybe, uh let's see, if you're watching us in twitter somewhere, if you're watching us in on twitter, let's see if twitter is also up uh to do. Yeah twitter is up, um looks like some people actually watching us, since we were great great great great, it's it's good to have. Everyone is here um today today what I want to talk today, so many of you know that clone builders. This is the show where we, uh where I'm doing some stuff or my colleagues doing some stuff, um sometimes successful.

A

Sometimes not it is not polished, and sometimes it's not even prepared. It's a 100 improvisation and uh today I'm gonna try to um show you how we can use this serverless platform called k native um together with cong uh ingress controller and clone kpi gateway uh to deploy some of the services and.

A

Yeah, so that I will be, I would be interested to do this uh also. I would love to answer any questions if you have any questions during this, this presentation, as always let us know where you're coming from so let's get or jump right in so we will need a couple things here, all right. So uh let me know if everything works everything sometimes uh sometimes I feel like my screen or, like my camera freezes when I show in my screen, but right now everything looks fine all right.

A

So uh let me bring this a little quick. So what we're gonna talk about this uh where's, my google, chrome, yeah, so keynative.

A

And keynative.dev.

A

So essentially it is a part of um so idea of key native.

A

I don't know how many of you actually used um that platform called hiroku hiroko was great.

A

It is still great, it's still great a great platform for uh deploying your applications and the way how they treat this developing stuff is it's kind of unique. You don't need to focus on infrastructure. You don't need to focus on um even compilation. I would say right so, with the uh with the heroku, you will be able to just like specify your source code and you just get push, and after that heroku will take. It will do the thing so there's no in contrary to kubernetes uh with kubernetes. We have all nice things.

A

We need to build our images, we need to compile it, build the images define how we're going to deploy this deploy the services to get access to this to these applications, and after that you need to uh even like provide ingress if you need to get external access to the system.

A

So with um with k native, it's a it's a kind of like attempt to provide a developer friendly platform to deploy and build your applications.

A

So we're going to talk about this uh and how you're going to install this and we we will touch today like just like a small um small fraction of the key native. uh What you can do uh with this and uh today we're gonna do like simple things: we'll install it. We will configure ingress, so the call and won't serve as ingress and the key key native allows you to do that and yeah. And after that we will deploy simple app. We will try to get access to this application and.

A

We'll see we'll see how it goes all right.

A

Let me know if you are watching this live everything is good. Ever you like it and.

A

All good now so before that I need to have a kubernetes cluster. So let's, uh let's try to create this cluster with this particular command.

A

So we're going to do this us east cluster, three nodes enable apis and we deploy this uh conc builders, we're gonna, do column, builders.

A

Let's see if I have enough space in my uh zone, so it will have a enough resources for me to deploy this uh yep so far it starts good. um I will ignore all these warnings for now, so it should be, should be fine.

A

um Oh, I didn't check. I didn't check which project I use, because I might use some of the wrong project, but we'll see if this command will fail. We can always start over now.

A

So what I'm? Looking at, like my stats, my stream is going strong um and uh I don't see many people. Where are the people while we're sitting here? Maybe you have some some questions to ask? Oh no.

A

I actually have some of the things to say, so um we, um if you didn't check the last time I did the udp ingress, go watch the previous previous cone builders also suggest what you want to see like go in twitter, tweet at calling inc or tweet at the gm ussa, and uh we will see um if we can accommodate your requests. So that's uh that's that's.

A

I would like to have this conversation as interactive as possible, so like having some of the requests from from the people uh in in the community, and the internet would be, uh would be a nice thing to have right.

A

All right so a while it is uh without while is running, so let me check um some some other things, so I see that uh my fps is going down for some reasons and I'm wondering if it's something that I do wrong or.

A

So, let's see we do have some questions.

A

I have a question from last week, proxy by passing, proxies by passing boy. Any idea. Why so you need a little bit more um need a little more details. So essentially, when the quant runs as a.

A

As a gateway for for easter, we use clunk to listen outside world traffic, but it also needs to communicate to inside. um You know you need to talk to this like service mesh and I don't think it is um disabling because, like the the ingress becomes a nothing grass, the the gateway becomes a part of the mesh.

A

So I'm I'm not sure what you. What do you mean by by these questions?.

A

A

Dreamcat four uh previous he saw- or they saw my previous videos, including udp. It was very helpful demonstrations. Thank you so much for this kind words that was great um okay. I don't see any requests in the log. um I think uh we we need to. I need to have a little bit more details on this one, um because um I don't know I don't know the. uh I don't know the answer uh right away.

A

Okay, so darshan uh decided to just like throw some aces here, um yeah the next time to do a demo based on the custom plugin. So uh if you're talking about the custom plugin that runs locally or runs inside kubernetes, I think it's a it's a the point of time when I say challenge accepted. So this is something that I potentially can do absolutely.

A

All right, so my cluster is up and running. um Let me do a few kind of like a housekeeping item so enable some of the um api in the bindings.

A

So the the our back would be configured all good now. So, as you can see here, k native already have 1.0 I it was uh last week. I guess it was announced that it can do uh 1.0, but uh my my demo is based on the previous version, so I'm not gonna. Do I'm not gonna attempt uh to do anything crazy with the 1.0 today? Maybe I'll do uh my own thing and after that uh we will see how we can do this um with 1.0.

A

So um first thing that I need to do is install a bunch of crds from key native, so I will go ahead and apply this plugin.

A

So okay, so kinetic includes multiple components, includes um the serving components because eventually component and today I'm going to talk only about the serving component, so we're going to be deploying just one simple app um and the integration with other components might be covered in other places like for example, last week at the davox london, I did a presentation with a friend of mine, james ward, from google, and we talked about a how to integrate key native eventing with the apache kafka.

A

So now let's deploy this. So when I'm done deploying my see our news uh it's time to, let's do this. One oops.

A

A

This one um I'll put my k9s here, so we can also see so a bunch of things just happened and key native will be available for us. Let's, let's take a look. What do we have here so far.

A

Now the key native service serving is active and the controller is up and running, looks good. Auto scaler activator so looks like it's deployed.

A

So next thing is that uh I need to install uh calling grass controller so helm a repo update.

A

A

So in this case, I'm not going to do any customizations for for for help. So in this case I'll just do elm um install clunk, so I'm just going to install as always we into uh default namespace. um Let's just do this, I'm not going to do any modifications. Maybe if I need to modify something I will do but right now not gonna.

A

Okay, create namespace, create namespace conc and let's install this through quan congress control. As you can see here, environment is created, sweet.

A

We're going in.

A

So I do have a this predefined command that will be waiting because we need to have an external ip address here. So.

A

Actually, you know, let me see, what's the name of the service service.

A

Okay, so in this case I need to modify my uh my script because uh quan when I install this with helm, it will add this release, name as a part of the prefix.

A

Let's see so now, if I do http dollar ip.

A

Yep uh so now quank is deployed and it serves our requests now. So in order to tell.

A

My last uh comments still still up. I'm sorry um in order to tell uh keynative to use quank, we need to modify a config network. So let's take a look on this.

A

So if I'll go to namespace and uh let's gaze key native service and we will go into config.

A

Config map and we're interested in a config network.

A

So this is example configuration blah blah blah. So you see here uh by default it uses istio as ingress, but we will modify this we're going to be telling this um key native fella to use our kong, our colon ingress. So for this.

A

I'm go ahead and use these this command.

A

So what it does it will change this configuration and we'll add this ingress class clong. So the kinetic will be using this as an ingress.

A

We patch that, let's see so now example configuration where is it why it's not using quank.

A

Oops describe date, example: okay, so uh it was like apparently there's two things that it has. Example. uh This config map has example like this like underscore example, and also this actual config. That includes the column as an ingress class.

A

A

Another thing that we're going to be using um since not many of people will have a custom domains for this um we're going to be using. So what uh what the key native allows us to do allows me to deploy application and provide a ingress to this application, but also it allows me to get access to this application.

A

um That gives me like url that I can access and I need to define what kind of domain that we'll be using. So.

A

In in this case,.

A

I will use this guy to forward all my requests, so in this particular case I will be using. Where is it.

A

A

Don't save any changes we go in here, which is the echo dollar ip, so that's my quan gateway.

A

So if I will go about something like this, it says not secure advanced proceed yeah, so it's still, it still hits uh right place. So it we see some message that comes um from uh from kong, so we're gonna be using this as our domain name in our keynative config.

A

So in this particular case we're going to do this config map that will include this config domain.

A

So since I'm executing this in.

A

Inline so, as you can see here, we're going to be using a config domain and.

A

It's configured and I'll just do config domain, and now it uses this as my data. So now all my applications will be deployed again. My applications, dot name, slash ip address, slash, oh, not slash, dot and stuff. So let me show you how this would look like so.

A

Let's take a look.

A

Let me open some text editor.

A

A

Why you cannot drag the tab.

A

Oh, why nano I like to use um not nano. I like to use micro, I like it better okay, so next thing is that we need to define our application and the way how we can do this is defining this.

A

So now here's something interesting: the um there is a new type of service and this service is more related to concept of microservice. So in this case, it's nothing to do with network service that has um significance for kubernetes world.

A

In this case, we're going to be using this service from key native, and only thing that we need to figure out here or like configure here is um image of the application and after that, kinetic will take this image and provision us with all required things that we need to do, um and in this case I will use some of the hello world um uh from go.

A

uh Let's, let's google, it and see what they can do.

A

A

Like this one, let's, let's let's find this and see what it does.

A

You can build this, um it's already.

A

You can deploy this in in docker, but some good people already deployed this uh good people from kinetic already deployed this in a google cloud platform.

A

Now let me do this: one save.

A

So what in this case, I can do apply service.

A

A

So new service was created, so let's take a look. How does it look like if I go to namespaces? I believe this service was created in default and if I will just.

A

Do so in uh in the key native it creates some of the some of the custom custom resource. In this particular case, custom resource will be serverless service, and that's um that thing is just like deployed my application.

A

How I can get access to this application now.

A

So in this case, let me do stuff like this.

A

That was service we created and now what you can see here. So when I get this service, it gives me this url and now this url is actually pointing to my application. So I didn't configure anything when I hit this. What will happen? I get the hello world, that's awesome so, like what happens here, I didn't do anything in terms of like externalizing access and, as you can see, let's see, let's take a look on the headers on this request.

A

Network and I'll see this one and response handlers. As you can see here, this goes through the quank. So what happens? Is I created this custom resource called service in terms of key native and only specified image since key native knows how to deal with? You know simple stuff like web applications, so it's created the services that required it created even ingress for this application, and now uh all the traffic that keynative will be created will go through the con.

A

So you can also apply um different uh plugins in and stuff like this, and it just works, and the cool thing is that uh if there would be some idling and there there would be some uh the pauses that, um uh for example, application will not be used uh key native will make sure it will. You know, go away so after certain time.

A

A

Yeah, it's still still up and running, so we will be able to get access to this one, and uh this is the name of the service. This is namespace and after that, that domain that we specified so so far so good. Now, I would like to deploy my.

A

If you remember, I wrote.

A

If you remember, I wrote this application that generates a different quotes and uh this application is located in docker. So, let's see.

A

A

Hub dot, docker dot io, if I do, if I steal, don't hear how.

A

Happydocker.Com, okay, sign in.

A

I will um log in real quick here.

A

And I will deploy as.

A

Because so, in this case, my docker id would be like this.

A

All right so my reactive code service and the latest and greatest uh snapshot is zero. Three. So that's my let's in my image. So let's, um let's deploy this right. Let's, let's deploy this so I'll. Just do cp.

A

A

Code, service and I'll just do let me grow code service.

A

um So in this case I need to go ahead and.

A

Replace this with.

A

With this image now name will be.

A

Quote service and now I'll just do.

A

Okay created, so let's just do.

A

Let's see if the application will be provisioned now, as you can see here, all these things are starting coming up and now quote service in default. Namespace will be available.

A

A

I'll just do http.

A

So, as you can see, that's um you know that goes through the column. Deployment of applications are super simple, like uh like incredibly easy to uh to to deploy this. um That's what you know you can do with uh with key native now, let's see what is going on uh in our application. Let's try to hit the hello world again see this radio is unknown, so what it will do. Where is it my hello world, if I will just hit refresh.

A

And uh it's a good thing that we can see so con can measure upstream latency, so meaning how long it takes to call to hit this upstream service.

A

So in this case um my stream server takes a long time to respond.

A

So if I will refresh it now, it's faster like why this happen, so key native will be responsible for um because it's a serverless and in serverless world you want to pay only for the things that you actually using. So in this case, if you're not using anything from.

A

If you're, not using this from, um we didn't use the service for a couple seconds, so kinetic was kind of like a shut down this application.

A

So now you see my quote service because it's not it's not used, no active connection. So there's no one spinning this and no one is using this, and in this case, if I will hit this again watch what will happen here.

A

So the status will switch to something and here's here's the difference between these two applications, so the application now see it's up and running and the response it takes me almost like eight seconds to um to start.

A

The um the pro not the problem, the the idea is that my application takes uh takes some some long time to start uh of my application that my my application that I use um in in this example, uh one of the.

A

My application here is written in java. It uses spring boot, so it's nice and cool application for for people to deploy. However, um the startup might be um might be a problem like startup time uh might be a problem here. So there is a thing uh we can actually try to um to to fix this right now so spring boot native image.

A

So in order to optimize.

A

In order to optimize this, we can try to build a native image that will be will be much smaller and uh I haven't tried with this framework, because I previously tried with the um with my application, but the framework that I use to um to do this, how it's called the the quote. Generation like this, like uh back to future quote generation, see again the application died right now and they both um not up and running. So, if I'll go to do this, like a pods.

A

As you can see here now, it's running it took us like eight seconds to start, let's see if it's a true actually.

A

A

It took us application six seconds to start plus it took some some time for key native to provision some other components. um Let's try to build native image from uh from my uh from my application, so maybe it will help us to to do this, so we're going into quote service.

A

Before I do this, my quote service here.

A

Doesn't have there's a bunch of pull requests, so let me update uh latest inversion of spring, so what we're talking about is uh two five six and two five: six quart service, protobuf port above so we're not interested in protobuf. But let's choose two two: five six quote service.

A

Let's try to build native image, so the native image in the in the java world. We have ability to um do this ahead of time, compilation, so the there would be some some plugin that will go through the all the code path that happens in my application, optimize it and produce.

A

You know, image that would be small and the startup time would be significantly faster. So I actually didn't didn't do anything like this before and I would like to do this right now. So, let's take a look.

A

A

We will get the latest version of spring here.

A

To 5.6 and we will refresh our gradle cache.

A

Let me take a look.

A

Okay, so it's still building.

A

A

Let me see if there are any questions, so there's no questions um here like I just want to make sure that I'm not talking to myself and there's still there's still people who watch this people. Let me know if you're still watching this.

A

Okay, so let's take a look: how this native image works, um getting started.

A

Native image options, samples.

A

Samples folder.

A

Let's see I'll just do.

A

A

Aha, okay, so I have this commented out. So let me add this one more time to to do.

A

Spring aot maven, but we're interested in gradle.

A

This is what we're going to be using it's not experimental anymore, so it's good to go.

A

Again, I haven't uh haven't tried this before so I decided. Okay, let me try this with you right now. uh huh Okay, now, let's see if my.

A

A

If my plugin updated now.

A

We'll see in.

A

Here we go tasks, build.

A

Build image why it is not doesn't have a built native image, yet okay, plugin is not found. So in this case we're gonna do this uh plugin management repositories. We will add this here.

A

Yeah so it looks like I don't have it here. So let's have it here.

A

Okay, plugin management- it's not here, so we're going into settings plugin management. It says repository snapshot.

A

We're gonna do we also add the release.

A

A

A

Okay um can't find spring experimental spring native. Let's see, maybe I made some typo here.

A

No, it should be fine.

A

A

Groovy release: um let's see, let me do this one ah okay. I know.

A

Adding repository for release- let's see repeal this one more time, so I'm doing some bold stuff here right now the my computer might even slow down when I'm doing this, and apparently.

A

um I don't know if you've seen this on the other side of the stream, but, um uh like my uh my laptop right now is just like you know, it's gonna fly the good news uh that I actually put the pre-order uh for new macbook, we'll see how this will help with the compilation of java and the compilation all these kind of things. Now we good uh now we do have something around.

A

What's what's the task we boot boot build image now we need to tell this to use.

A

um So, let's see what we can do spring aot complete code sample with default values. So let's do that.

A

If I run this boot image, let's see if it will execute.

A

So it is relatively complex, a relatively complex project, because it includes a lot of things, including grpc. It includes some other things, let's see if it actually will be executing. uh This is warnings it's okay to use some annotations now.

A

Start doing some some cool stuff, uh one error: no such file or directory docker demon is running and accessible. Okay, uh it uses door care, so we need to start this docker daemon.

A

And we're building this uh reactive code service image.

A

Docker, uh okay snooze!

A

I haven't updated my docker for a while, so I don't know what will what will happen.

A

uh Okay started.

A

Let's see if anyone tweeting about this session.

A

If anyone actually watching this in twitter, let me see.

A

Yes, we're still doing it, we're still going strong in twitter. um Now dawkir is up and running. So let me try to run this one more time.

A

Ignoring all these things, oh, like maybe next time I'll show you how I can I don't know with key native- you don't need this stuff, but like what I was doing for for some of my applications, as you can see here, um actually generates a bunch of kubernetes um artifacts for my application. So it's a spring boot application based on some sort of annotations.

A

um This plug-in um goes and generate all um artifacts that I need to deploy this application, but with key native, as you saw, I just deployed this as a service specifying the image, and that was it.

A

So, let's take a look uh where's. My.

A

uh Run if it's bills? Okay, so now it's interesting.

A

The weekends speed up startup of application, but the time that it takes to build this image will significantly increase. So the now we're waiting.

A

Let me see uh if I can show you.

A

I used to have a command that allows me to see status of docker.

A

A

A

um If you know how to get the.

A

Okay, so now interesting thing is happening so here um the remember when I was talking about the heroku in the um the platform, so heroku actually popularized this concept of build packs. Essentially when you, when you put your code on version control and push it to heroku, hiroko, will scan through the code and recognize this uh based on certain criterias.

A

For example, if there is a build.gradle file, most likely using gradle to build this application to build your project um and the concept of buildback actually came out of heroku and start developed into something called cloud native buildbacks.

A

So cloud native, build packs is a community to support it. um Yeah, that's uh that's the timeline. It started at heroku after that that pivotal was doing something for cloud foundry and also start developing this and after that they join forces and release cloud native, build packs. Now for this, in which uh spring uses build pack a spring boot plug and use build packs to figure out a overall story, it knows how to build spring application, how to build a optimized.

A

Okay built image: how to build optimize, the optimized application. So, let's see um I will be I'll get back to this one let's, but I want to run this uh test where's, my um I'll just do local run of this application and just make sure it works.

A

So I'll just took a run version. Four, let's see if it will be able to execute this image.

A

Reactive quote: service; okay,.

A

A

Okay, let's see, what's the what's the problem.

A

uh Inspiring to this.

A

Now application is up and.

A

A

Application started and what I can see the startup type.

A

Is it actually up and running.

A

Should be right.

A

Looks like it's up and running, but it doesn't seems to work because, like no cpu.

A

So let's try this in production right, so I will do.

A

Just do docker push.

A

ah Okay, so looks like I messed up with the.

A

A

A

Yeah exactly so, I need to build the image that not uses default things, so I will not be able to push it. So um in this case, I need to do this one it's going to be for snapshot. Let's do this one.

A

Hopefully it will use cash to to run this.

A

So if I will not be able to finish it right now, we will continue next week, where I left off so we'll see we'll see we'll see we'll see if we have any success with this one.

A

But also you know, we will learn something new and cool. So what would again for those of you who join us like, I see vimal. Thank you so much for this uh encouragement, vimal uh thanks so much for joining us. uh What are we trying to do right now? Is uh we deployed our application to uh key native? We expose this application through uh quank, and now we need to update. We want to optimize the call start in order to optimize the call start, um instead of like a six minute start.

A

We want to start in a few seconds of this of this application, so.

A

That's why I want to build a native image out of this application. Let's see if I will succeed with this.

A

As you can see here, it has this builder aware about certain layers that we need to put this I'd. Put. The certificates uh puts the uh liberica, which is going to be a version of opengdk, after that uh it puts the different uh spring boot uh related things to here right, so it was build successful.

A

A

A

Now we're pushing the reactive service 2.4.

A

Not 2.5 0 0, 4, 0, 0, 4 snapshot. Sorry.

A

Again streaming the same time and pushing the image darker, so you know that's what we that that's. What we're doing here.

A

Okay, it's there now.

A

That was seen I'll just do.

A

Service, uh let's update it, this one snap shot.

A

And we'll just do service.

A

Configured and drumroll.

A

A

Oh not good, let's see if application will start.

A

Okay, okay, come on.

A

And if I will do something like.

A

And it works, you see and latencies is much smaller wow. It works fantastic. um Why? I cannot see how fast application starts to do.

A

Okay, so I consider this as a success. So if you were here a few minutes ago, you know that the startup time of this application took me uh and it's I'm pretty sure, it's new version, because old version was using 5.5 or whatnot.

A

And it took let's: let's go back, um let's go back and we go into this um serverless service. Let's wait! Let's do this one more time now, as you can see here, also keynative handles a versioning of this. So now we can see version 002 is deployed because we change the version of our uh of our uh component.

A

Now, let's wait until it will. You know, go away, uh I guess in a few seconds. Okay! So now it's done so uh we third request. We hit this application. Now, let's try to do this one more time. That's that's quad service and where's. My.

A

Let's call it one more time.

A

A

Come on still eight seconds, I'm probably doing something wrong. Probably I'm doing something wrong here um which supposed to be starting faster. I don't know why it takes some time, but I need to investigate. Maybe I didn't even enable this. It's supposed to be supposed to be enabled right supposed to be.

A

Yeah, okay, so I will. I will uh try to investigate it's not supposed to be that you know fun in games.

A

I will wrap this up today. For you, um my name is victor gamov, as always I will be here. I will try to be here every two weeks and uh entertain you with some cool things. However, we did learn something today. We didn't learn something today um how you can use a key native with cong and uh deploy applications. So join me next time in the two weeks, and I will show you how you can optimize this deployment. I tried something: maybe I missed something most likely. I missed something um and uh yeah.

A

That's um that's pretty much it for today, um don't forget to um to hit me in twitter where's, my where's, my title: um that's my my twitter down there. So you can. You can follow me on twitter and ask these questions in twitter. Plus um this video will be available. You can write down the comments below. I would love to see what you're, thinking and I'll see you in a couple weeks, basically maybe in the two weeks- and we will see how we can fix that all right with this take care.

A