Cloud Native Computing Foundation Kubernetes Day India 2019, 29 Mar 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Sponsored Session: Using Virtual Nodes to Auto-Scale Your Application on Kubernetes - Maheshkumar R

Description

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Sponsored Session: Using Virtual Nodes to Auto-Scale Your Application on Kubernetes - Maheshkumar R, Microsoft

Quick talk/demo about how to use custom metrics in combination with the Kubernetes Horizontal Pod Autoscaler(HPA) to autoscale an application. Virtual nodes (virtual-kubelet)let you scale quickly and easily run Kubernetes pods on Container Instances where you'll pay only for the container instance runtime. Demo application using ServiceMonitor for Prometheus, a HPA, and a custom container that will count the instances of the application and expose them to Prometheus. Finally, Grafana dashboard to view the metrics in real-time.

About Maheshkumar R
Maheshkumar R is a Senior Technical Evangelist at Microsoft provides solution architecture for ISVs and start-ups in Azure. He focuses on Application dev and modernization using containers, microservices deployed on Service Fabric and Kubernetes. He is a Certified Kubernetes Application Developer (CKAD) and Azure Architect.

A

All right so between lunch and you guys trying to keep you engaged.

A

So we were at all controversial Kuebler as a basting and storing data for virtual nodes, which will notice microsoft, implementation of virtual cubelet before that I worked as a miter saw having technically my analyst at Microsoft I worked with ISPs and startups, advising their containers, development and service fabric and kubernetes lady communities. So let's that's.

A

What's virtual cube land right so but virtual cube land has been discussed. The cube corn 2017, but this is the pet project by Brendan burns right, so he has written as a pet project in using the type script and then, after seeing the lot of sixes, then he thought, let's take it as the open source by writing everything in gold language, so one secret has become a gold language admitted in the open source and I kids. Have then a lot of other providers? Like you know, the Amazon and VMware hyper have searched.

A

There are 12 providers today they check this as a base and then start writing their self provide a separate providers further for an example. If you look at here the virtuous cubelet on a higher level, it's I mean it's a kind of a trying to pretend that it's actually a cumulant, but it's not actually cumulative right. It's not also it's not a replacement for your cubelet. It will be in the side by side in the same box. It will try to take the incoming load and the path to the canary instances guarantee right.

A

So here the advantage. What would get here if you look at in the higher level, there are four nodes, but there are the fifth one of the virtual children right. There is a node node at all, so that is the provider. It's a charge to the provider to span that you know the load to the container instances. It could be learning in a as your AWS or Ali Baba, who I mean right. It's a flexibility then, today there is no flux, ility to write it in the bad metal, but it's there in open source.

A

Anybody wanted to contribute, or anybody wanted to write, as provided for badminton it's more than welcome and lost. It is somewhere. This Microsoft I know what we talk like this is getting adapted very well, let's donate his project to the CNC. Now this this is getting not shirt by CAF and thanks to CNC a the community here to imitate this, accept this project as one of the good project to not share not going further. So what is the benefit of going for going the crutches cubelet?

A

Traditionally, if you look at it, this is how the scanning books read. Let's say you have a horizontal part scanner right. So traditional ways like you have three machine. Looking at the matrix, you try to scale, maybe a fourth or fifth mission right traditionally, when you have this kind of Roboto scaling happens, you would see that there is a latency. You know getting the image hold on top of the image go to set up the docker run time and then drop the image by looking in the database conditions or maybe a VDC.

A

We ultimately know all the exactly, maybe a two minutes to set up everything right by the time you lose in customers. Experience right, somebody in case of, if you, if you throw the worst of all scenarios, are reversible workloads to contain a resistance. The spanning a container- this is very, very, very quick right in matter of maybe 10 seconds to 20 seconds depends on the put the container images right.

A

If it is co-located in the same data center, you will be able to set up this whole container instance quickly in a less than seven to eight seconds right. That says: that's the beauty of this virtual Hewlett and having the worst of all scenario, our team throw containers directly instead of spinning and removes.

A

If you look at here, I am going to maintain this for moon as it is, whereas I am going to burst all other extra incoming spike in 1000 times my cuff load two containers, you know it's a four-way, because a continuous are billed per second straight. I am NOT going to pay for those additional nodes which I am basically I'm over at all. Those thing.

A

This is a quick thing as I work with startups and is T's adaption of containers academically. We know we do lot of things that the doctor is another thing, but the continued maturity is still there to happen. At least in India I see the know.

A

If you askin and the more room discussions, a lot of people are still learning about what is containers an office, but it's a good time to start with that business by 2020 and they're got enough critics that either you know some form of containers you will consume or it's going to produce the containers right. So it's a great time as a developer. You start jumping into the doctor or maybe us what are the containers you have preferred by the time I wanted to thank dr. community.

A

If anybody is doctor the fans here, any doctor fans here thanks to doctor, because it's six per day, we recently celebrated without talker hello. This nothing nothing happens like this is massive conference like given. It is a massive open source activities, because the doctor completely changing the maybe look at the virtualization. So, let's quickly look at some demos about how you could actually.

A

This this is the path that you can have in a github. You can go and check it out. There are 12 providers today available supporting this virtual equivalent, which is a good thing. The more and more going to comment, if any of you happened to listen to Brian burns in the last coupon conference. He give a very quick chat about where we are meeting as a cave minute is coming tonight, so going forward, I mean we have only 50 person achieve as an honest Cuban.

A

It is right, so your master notes are completely taken by the cloud provider that still there is a risk of maintaining those worker nodes by by having this virtual cubelets story going perfectly matted with all those master nodes taken by managed provider- and this is also going to manage service there's a chance that you will get a hundred percent several us criminals right. So you pass all those at risk of maintaining the much sugar shoots to this cloud provider and you focus on your application.

A

Everyone so I think this is still in a kind of a excremental project, but I think by made of this year we'll get a clarity about. You know how you could actually move your actual workload using this virtual cubular based project. So these are the providers, as we discussed so I am going to some Sonia button unconscious. So the contoso is a new developed, newly developed in e-commerce portal. I see that this is a fractal application.

A

They we are going to prepare for a massive day or a big day, celebrations like in Amazon or Flickr right, so that the capital saw has recently launched a zoo player. Do we have a song playing my mp3 player who want a mystery language anyway, mr. joseffer, so they couldn't able to take up the Lord. You know incoming load at a certain time right, so in the last big day, sale they faced a problem like they couldn't able to the quality.

A

I would accept all the incoming requests at the same time in the same opener right. So there are a lot of people experiencing login issues. Are they couldn't able to search the catalogue on all the front-end issues? Basically because intent is very hard, but the Kuban it is trying to scan by adding more and more machines, but it wouldn't be able to accept all the nodes, but this time they made a ID on that. You know they thought let the instead of adding more roots, like being add as a container instances right.

A

So let's try to generate some load.

A

So I'm using a hey, that's again, a retro language. It's a critical load generator I am going to generate some load on my websites in the context of websites. So what is going to happen? It will wait for some threshold or a matrix and automatically understand that okay I cannot handle more than you know. I can't handle this. So let me go on spin large container instances in the background right. So instead of spinning and nodes, it is going to pass all the internal traffic to the nodes right.

A

So I have also remedies installed as a container in the same bar, so it is going to pull the logs and then put it to the graph on R James. So we will quickly see, looks like my time of the score.

A

Let's come back to the graph on our dashboard to see how my containers are coming, and you know helping me to take the incoming. You know right. So if you look at it in the left side, I have a very I'm very poor in designing. This is one of things. I learned last week, time I picked very quickly another.

A

So if you look at here, I continue to have only one load cluster right, so my building will be always charged on only per node so because of the increased in the spike in the traffic I'm saying that hey what just keep learned, please take care of all my incoming traffic to the Container instances directly in trouble, spinning and moves. So if you look at the right side, it starts with the zero and then eventually it starts with five based on the number of incoming requests. It creates more and more pentane area instances.

A

By the way anybody tried to engineer instructions as your container instances or any other perfect. So it's like it's all cleared in your virtual machine. Now containers are taking everywhere. Containers are taking over the data center, so you can directly create a container instances. Containers the service that suffice tray to me, which way to say it could be a sandbox container. It could be a subdomain container to be a law generator. You can directly enter containers from the cloud provider. That's idea.

A

Then we go to the reporter and then yeah, so we have two more is ahead. I know, eventually, you would see there are 50 or 60 containers directly coming. If you look at it very closely, I have only important virtue missions. I am going to pay per month, but all these containers are going to build by seconds. So it gives me or it takes my incoming, you know perfectly and then you know the possible scenario is now handled without losing the customer experience.

A

The slowly it's picking up, you can see that if you keep it for some time, then you would say that more and more containers coming here. So so we are engineering outside in the Microsoft to boot. If anybody wanted to try it or try out this virtual cube lab, we call it as a nutshell. No, we don't care so much equivalent. We could also have it should be black in any cloud provider. Today, it's still an experimental project, but virtual and nodes. We are working as a Microsoft. We try to reuse the same open source.

A

What we have put it outside as a virtual node. We cannot as a virtual nodes underlying. Is that what should accumulate? So we are happy to help with any questions around was virtually no no circulat. Yes, they are on that might sell feet.

A

Good, that's a big demo catch you guys outside.