Cloud Native Computing Foundation Helm Summit 2019, 1 Oct 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Dancing with Helm, Skaffold and Minikube! Medya Ghazizadeh, Sr Software Engineer, Google

Description

Dancing with Helm, Skaffold and Minikube! - Medya Ghazizadeh, Sr. Software Engineer, Google

Join us for KubeCon + CloudNativeCon in San Diego, November 18 - 21. Learn more at http://bit.ly/2lmMzip. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy and all of the other CNCF-hosted projects.

A

Alright, let's get started so um hi everybody, I'm, media I, actually just got here a couple hours ago. It had a crazy crazy travel story. Misfortune! That's my friend was actually time you in stuff your talk. If you talk about that, it's more interesting right, I, don't think I'd be professional, just to talk about my travel stories yeah, but maybe after a couple drinks later, so my name is media I'm, after mini Cube's maintainer and today, I want to talk about three things: mini cube, scaffold and helm and how they would work together.

A

So by show of hands who has used mini, cube or knows wow, that's pretty question: okay and scaffold: okay, not that many okay and helm. Okay, that's as much as you, okay cool. So what is Mena cube, the best way to learn kubernetes and actually the real kubernetes cluster on your laptop, like I, don't think any other tool provides as real kubernetes experience on your own laptop out, the mini cube, so the corner, maintainer Thomas is our lead and you have more than 400 contributors across the world. Who am I.

A

I was previously a senior sre site. Reliability engineer, Google Hardware were actually managed, helm there and currently I am a senior software engineer at Google containers tools, which we work on open source, I'm so lucky that Google pays me to work on open source things. I cannot be happier so I work on mostly mini cube a little bit scuffle many cubes started 2016 anybody use kubernetes 2016, oh, that's, not 20% 30%! Well, okay and the idea was, you want to be able to run kubernetes and on our class and our on machine and Don learn.

A

He started mini cooper, repo at 2016 at April, and it has been growing since then. Most of the people use. These are based on a survey that we had last quarter. Survey use it for development and 5% use it for testing and 30 person usages to learn kubernetes. Is there like stats?

A

It's some mini cubes architecture is pretty.

A

If I want to describe it, there is a bootstrapper that runs inside a virtual machine. It could be VirtualBox, it could be KVM, it will be hyper kids and we also run we have a driver called non driver which actually runs basically on your computer.

A

That's not our best driver because only works on Linux and we have plans to improve that because it's basically annastolz cover and yun your Linux, but that one is actually used as a testing tool in in Jenkins or other things. People use it to install mini cube inside the VM using the non driver and kubernetes mini cube, supports a lot of different container runtimes and we have more than I think 16 or 20 islands, and we support all the kubernetes version.

A

I used to work for a company called target and where we manage our own kubernetes and I remember, we used mini cube to emulate our current pride environments because many cube, let's do two installs exact version of kubernetes that you want. So we wanted to see if we install this app on this exact version. If you upgraded from this version, based version, what's gonna happen, so it was a real world experience of kubernetes and we I personally use this.

A

When I was as target and I was liking it, these are like the basic commands of mini cube, starts. Sad-Ass, interesting ones are like service and tunnel service will give you the you to the service. It could be a Northport or load balancer or any other service company service. The tunnel is a new command that you have and that actually makes your network inside mini cube, accessible from your laptop as like as like. A load balancer.

A

These are the list of the add-ons that mini cube, supports like, for example, addon manager, dashboard all different. We have a very interesting I, don't that we didn't create ourselves. Other people added it as GPU and I've. Seen very interesting. Vlog person is GPU add-on and they're more add-ons like gee visor is actually one of the most popular one on mini queue, because that's what went very fast and easy way to try it. You visor on mini cube to see how, if it will actually prevent the security attacks that it claims it it does.

A

We can just test it. I mean you and see for yourself and.

A

This is a different representation of the architecture of mini cube like this is like different versions that you can support, for example, currently the runtimes, the the brown and the purple ones we are flying to support like we support darker cryo continually divisor, but it don't support color yet, but we're working on it and another thing that we are also working on. As I said earlier, Mini Cooper runs inside a VM unless in a non-driver non-driver, just oops runs like basically on your bare metal.

A

It's we don't really recommend it on your own machine because it's it will live over. It will open up ports to outside another good experience for for as a developer, app developer, but we are working on running mini cube inside a container shall talk about their mini cube, supports all major operating systems out there, Linux Mac OS Windows FreeBSD. We used to not have good integration test for Windows. Actually, our integration test with not running. We had them, but you are not running this choir.

A

We made it our first priority to make Windows a first-class citizen of mini cube and make sure our integration tests run for Windows, as well as Mac OS on Linux.

A

Almost all the features of kubernetes that you can think of that can fit in mini cube, one of the privileges of having using cube ADM inside the VM is like. We can basically do everything you want inside there and we can emulate a kubernetes.

A

Environment completely from volumes load, balancers, runtimes DNS as I- don't see CNI plugins here, but we should have that CNI plugin says we any kind of CNI plugin you want to. Try can try it on mini cube.

A

The principles of mini cube has always been user friendly, so it was always meant for a beginner who wants to try out kubernetes, so they don't feel scared and they should feel very easy to communicate with it. Now we also really care about being inclusive. I mean it's a being inclusive. We don't really just talk about it. We we actually do it.

A

We recently added five written language, mini cube translations, and we noticed something whenever we had a user outside us in a in a country that they, the main language, was not English or not common, and they would just create an issue. You just say mini cube, doesn't work an empty issue and we felt bad that we could not even communicate with them.

A

Like I mean they did that all the work of going through github, creating a login and just say mini cube, doesn't work, but there was no locks, but you had the issue template that says: hey here's, how you give the logs here's, how you give the information we need, so we can help you. So we actually made issue templates for many languages out there that we used to get and through Google Translate. Now we can help them.

A

It is absolutely a beautiful experience to see that people who used to just come and say mini cube, doesn't work and and no message nothing. Now we can communicate. So it's easy thomas, given our lead thomas stromberg, he gave a great talk.

A

I, just everybody watch, that's called kubernetes for the next billion users, so in in the in the upcoming years. 1 billion users are gonna, come to internet and none of them speak English, and but they all wanna contribute to this experience of open source that we have had. But how are we going to communicate with those? We should really care about.

A

The countries that have slow internet know English, but they really want to be part of this ayah, meaning queue. I think we have done a lot of priorities of to make sure that happens and class platform. We always never discriminated, even though, like majority of the Google engineers like use Linux, we did our best. We recently bought Windows machines to make sure our labs have testing and windows and all the platforms that people use, not just the ones that we like to use.

A

We one of the things I like about me before I was a maintainer. Myself was like you could trust it if, if it was giving you a feature, you could trust that it's working and one of the downside has been like many key- was not the fastest option out there, but it was it. I could say it's one of the most stable options.

A

These are a graph of our code piece, I, I'm gonna, skip that, so you can get to more I'll show you all what is coming in mini cube, five times faster five times less resource usage, single step, installation right now. If you have to install mini cube, you have to install virtualbox or KVM or hyper case, and those things could be frustrating, especially for new users like going install, virtualbox and install this driver. So we run on roadmap to make sure it's a single step.

A

Installation and the user should not even know what is VirtualBox or hyper cater kayvyun. You should just detected for them. It's like based on your machine. The best thing for you is hyper, get or the best thing for you is KVM and we are also moving away from.

A

Route FS to temp FS, which is gonna, make the mounting performance in mini cube tens of times faster than current performance, because it's gonna be all in RAM using ten purpose and it's a much better technology and as I mentioned, we have a localization for five different languages, but we absolutely love anybody who wants to contribute any language, especially now that we are in Europe. It does speak more languages than people in America. We would absolutely love your help and in adding more languages to mimic you making it more inclusive.

A

Another critic that Munich you've always had was you could stop it, but you cannot suspend it like I mean a VM could be suspended, so you could come back fast. So that's also coming and remember. I said there we have a driver called nun that basically annastolz mini given your machine and that's a terrible experience right now, because you have to be a rules and then it opens up your computer to ports. So you don't recommend it. You're gonna make that their non routes and no open port to the outside.

A

We are, we are planning on automated back reports, so, even if you keep crashes, we should provide a way that, if you are willing to enable that feature report it to us, so we so we don't even have to go through crying and shoe and waiting for us to respond to that.

A

I strongly suggest this talk. This is a really beautiful tacit, bringing kubernetes to the next billion users. You can easily find on youtube, I enjoyed that talk myself.

A

Okay, so in this summit I'm announcing something a preview version of kik kubernetes in containers and what it is you can run kubernetes in containers and the repo is subject to change the I'm. Just putting in my personal repo for now. I am super excited for that, and so is a chat.

A

Screenshot I I got from one of the maintainer I'm, almost booking a vacation to only work on kik this week, hahahaha so I mean I, got myself excited on this and I got other people excited and then I got more excited that they were excited. And now, if you are all excited- and it's like an explosion of excitement- and what is kick kick is a library that you could use to start a kubernetes cluster inside the container. There are other tools out there, but this is a library.

A

This is not at all, and this the difference of kick as a library is super minimal and it supports different OC is because it could be either darker or Padma. That's why it's called kubernetes in container, and it's hyper focused only on handling that part, and it has already features that others don't like supporting CPU and memory size for a container limiting the security whitelist. So right now, if people wanna run kubernetes inside a container, they basically have to give a carte blanche for all the security ignore the darker super open, scary security risk.

A

That's we don't do that. We only watchlist the one that we actually use and super small bass and supporting diferencia nice.

A

Currently, we are hoping to release this by the next mini coopers to release, so that would make mini cube five times faster and five times less resource-intensive. That would do a lot of help to the people who develop on mini cubed ale on daily basis. So let's see P users start faster and just get things done inside a container without waiting for a VM to come up or spend your CPU time or your RAM time.

A

As I said the report that I said you could actually go look at the examples and there this is just le super early preview. I did not intend to make an announcement, but this is because we are here: let's, let's give you guys a taste of it. This is everything subject to change like nothing is gonna, be this even the repo, but this is the like the taste and you can see how it works.

A

So the topic of this talk was mini, cube, scaffold and helm actually dancing with them.

A

The idea was so if you want to develop an app for and you want to use kubernetes, you first write your code and then make it build the image darker build and then push that image somewhere and then deploy it somewhere mini cube or or a GK class or whatever your company is and then each time you make a change.

A

Let's say you change the port of the container, I'm, sorry and or or if you change the mount path, you have to go change all those yellow files, and then you have to verify that it's works.

A

It's actually a frustrating experience. A lot of people end up just developing on their machine, as opposed to devoting in inside mini cube or a container kubernetes simulation environment. I'm curious here.

A

People who hope how many people develop on their machines, not on Anna in a minute, okay, and how many people develop inside the kubernetes like GK, your mini cube or any kind of communities, Wow, okay, so more people actually developing under machines, and that causes some frustrations when you have to translate all of that work from your local machine to Yama files and every time is gonna work. What, if you had that the same thing it was just working, you didn't have to change anything. The same thing, just push it to prod.

A

So this is like a like. A small table. I made local machine. Has this problem also, like you know, Python, to Python 3 right, like your system? Python is Python 2 and then you wanna, install Python, 3 and then screws up everything, even if you use virtual and local machine experience. If you develop too many other projects, it becomes horrible and then you cannot. You have to translate that to a kubernetes deployment llamó and then, of course, this one doesn't have a build image or deploy image.

A

So it you don't even have that same story with rocker Composer mini cube really well. The only advantage of many cube is this: one is that you don't have to translate it that compose file to to kubernetes the ML file.

A

So scaffold is another tool that my brother team is working on: I'm, not after maintainer, but I worked with them closely and their focus is to make it easy. So you can develop without thinking just develop on your machine and just be able to deploy it locally or remotely.

A

How does it work so you have a repo and, don't even say anything just start a repo, don't even thought: where is anything, okay make a go app or no GS or anything, and then just put a scaffold that yamo there and it automatically tries to understand your repo. So this seems like the manifest files. This seems like the app file the go go up.

A

This looks like a static file, so it watches your source code and if there is a change in the source code, build an image for you and then it deploys that to mini cube for you and then, when you change the code as you're typing, it keeps doing that, but also does it's much more than that, for example, let's say you're developing an app design ogs and you are mounting a static HTML file to this container.

A

Your JavaScript or Go Go app code did not change at all. Just the static file changed. It will not go rebuild the image you just sinks, the foul, so it's much faster, much smarter, I'm gonna show you like an example, scaffold llamó file. This is like this. Will you put it in your root?

A

You could actually actually keep all of these guys empty, but it will try to figure out as much as you want. If we look at this, there is a sink, and this thing tells that anything inside this guy source, star Jas. If I cheat changes, do not rebuild em, it just sync the files, so it makes your development much faster and also even if I didn't even mention this think. If we go to this code and look at the.

A

Docker file, it will try to infer what things it should it should sink. For example, in this case, it will try to sink these guys, the copy ones that the ones are not your source code or your binary.

A

So in this example, the one that shot as soon as you start changing your code. It builds a darker since syncs the static files, but it won't rebuild the docker image because it's just HTML static files and deploys it to mini cue and then checks that the mini cube service was healthy and if it doesn't we'll, let you know- and by default it looks for a folder called kids for your deployment animals.

A

But you can specify any other folder, of course, to where your your deployment jános did. You have a question. I saw hands, but I didn't okay, nice, the lights are too much. I saw hands in the lights.

A

Scaffold so before we go to the next slide, all I had to do was to scaffold dev and to automatically detect my source code. It will try to make a docker file for it and build it. For me, it sounds like magic bye, it's not it's not magic. It's very, very actually, straightforward Scout supports three deployers and cube CTL, helm and customize and the rest of it sake. I'll show you an example of how to work scaffold with helm.

A

These are the scaffold. The important commands that I just separated for you guys, dev and delete, are my favorite, because that's basically does most what I want I, don't really need it. Okay, it does have a debug which is beautiful. It doesn't matter if you have a node.js app or a go app or C++, no matter what you can actually debug your your code using scaffold, and for that you have to watch this talk by david guetta. I strongly recommend this talk is a really good talk.

A

He will show you how to debug an application in your IDE. You put breakpoints and you just type scaffold, builds the app and runs it for you. You could put breakpoints, it scaffold waits for you there. It won't go more more. It's very neat, I, absolutely love it, oh and then why the name this talk, dance well, I, I started dancing about one year and eight months ago. Let's watch this clip.

A

It's like this is salsa dancing and if you see there's a circle of people that people you know and the teacher are in the center I used to be in that circle. But nobody wanted dance with me because I was absolutely terrible. It's like I have to dance with you. It's like and a teacher. You like I can't count this to be like I'll work with you like separately. It was embarrassing and but I didn't give up. We have some Germans here right.

A

Can you translate that this no man, I'm not going I, want to dance right? Is that right, yeah, so I did not give up I. So what I did I I recorded videos and I went home and analyzed them, but analyzing salsa is very difficult. Like you have to the most important steps are 1 and 7, so 1 2, 3, 5, 6, 7, 1, 2, 3, 5, 6, 7, 1, 2, 3, 5, 6 7, so that was like 6 rounds of dance, very quick and so I had to like pass pass.

A

Pass pass pass pass pass and it was so frustrating it's like. Okay, I have to automate this process. It took me 20 minutes to like watch one and.

A

But the good news is, after eight months now, I teach salsa dancing, so I went from somebody who everybody's like go away like so anyway. Another thing I was like I disliked about the players, as all the players have that controls at the bottom, like the play and pause and I wanted to be a top, because the teachers feet are at the bottom. This discovers the feet. You can't see what is happening anyway, so when I was preparing for it's like. Why not like you know, oh my god, I'm running out of time.

A

I think why not use helm and mini cube because I make it maintain. Why not talk with my own food? You know alright, why don't I like as I did and I used some mini cube and scaffold to to do this I strongly recommend those talks that I give you guys. Those are like because this is a short talk, but those will give you so much in more detail. The Thomas and David casual stuff, I'm gonna skip quickly, so we get to maybe take cuts of questions too, but let's helm.

A

So we I didn't talk about how I'm sorry, so one beautiful thing about scaffold is it can actually deploy with helm. This is a the top part is in you're familiar with it. Just is given the name of image you say which folder you should sink, so it doesn't rebuild that image that be that part.

A

We all understand- and anybody who has question on the first part before the deploy, okay, so after I deploy we're telling it if it's build and it's deployed successfully to mini cube, also deploy it to where deploy it to helm using helm.

A

But what the released name is D, geek, x, cake, stable and the chart path is in my in my repository, so I can make a chart and make scaffold to actually use hum, which is beautiful because later, if I want to deploy the same chart to prod or anywhere else, I am confident that this has actually works on my own machine and it will work somewhere else. I'm, not gonna, translate from KC Ahnold to pound charts and all that mess I'm just using the same thing everywhere. That's how I do for things.

A

I think I already talked about it. I'm gonna skip as much as I can. Oh, how about so. One of the frustrating part of my developing as a developer was like choosing a database. A I did not like that. I started, MongoDB and I switch to Postgres and I was like, which one is better like how about I have both versions and I do the eyes above one app but I, deploy it on one with the big one with Postgres.

A

So you see, I have two releases in helm, so I have one diggy diggy stay stable and 1d geek cannery. This one uses Postgres because I'm replacing the values, the helm, chart, values and I make it use Postgres, instead of so I'm developing one app, but it gets released to two different play. Two different releases and I could get to see which one is doing better and it's all by scaffold, not even touching about it. It just I just say scaffold dev and it's just doing all of that. In the background.

A

I'm, just typing and coding in just three builds and deploys and lets me be happy yeah and then scaffold has more features like you can actually build pipelines to say it's after you deploy to its this environment. Due to this thing, so I'm not going do that.

A

How much time do we have.

A

Let me check I think we are out of time, but maybe I can do a quick demo. If you want to stay in touch, if you I, we have super welcoming.

A

Contribution contributor experience for mini cube- if you are, if you want to start contributing to kubernetes project I, think mini queue is one of the best places we label the good first issues. If you just search for good first issues, and we actually do guys usually the process of getting your PR done, we absolutely love it love it when people new people come, and so you want to contribute. Let's keep that in mind. You can ping me and slack off, kubernetes, add media and let's make it up.

A

Let's go like a super quick demo, but okay, so right now a mini cube status.

A

Okay, get pods, you don't have anything helm list, okay, so we don't have any pads. No, no! So I am gonna start this envious code by the way, there's an extension called cloud code, which is basically uses scaffold in the background that I strongly recommend learning that because it just makes scaffold like graphical anyway.

A

So this is my dance app I mean it's just like a template. Now let me make it bigger, so this is the chart for it. The helm chart for it right and you have these values.

A

This is a static folder that I told you guys. So let's go do this calf old death, oops I miss about it, so scaffold automatically watches my source codes for any kind of changes as soon as I change, something it's smartly understand. That is what was this code or was it like? A static file?

A

Do I need to sing the fallow, do I need to rebuild damaged or do I need to rebuild the binary, so, let's and then and the annoy window, let's mini cube service list, so we have it deployed to version of my app one, the cannery and one stable. Let's open this table, I mean this is a hello oops, any open anyone, hello, helm summit. So let's go change this guy too.

A

How are you guys so.

A

It changed that so, let's look at the helm list. No, so it has only one revision because it did not make a new release because it was a static file. But if I had changed the code, it was smart enough. It says a the go. App was changed: I need to deploy a new binary, I need to do new image and the revision would have been I think my time is up, but I would love to take some questions. You guys have any questions. Okay,.

A

Yeah you can provide the relative pass or absolutely pass to it.

A

Actually I have not read. I do not know enough about that, but the scaffold guys have a slack channel. They're super helpful I'm. Just like a noob user of scaffold I'm, a intermediate me.

A

A

Yeah they have a road map in github. I know there have a lot of exciting things. I don't know, I don't want to ruin it because I is something exciting. Coming up: I, don't I, don't want to be the guy who's like say it I. Let them do this.

A

Yes, I am hoping for October mid-october to be there, but I told you guys. I have a crazy travel story, something like I am kind of stuck I lost, my password and everything. I don't know. I'm gonna come go back to United States. So as soon as I go back to NSA's, I will work on it.

A

Any other questions. Yeah go.

A

Yeah, that's not on the near term, not October, but in 2020 years in 2020. That's on the roadmap, but not in the near term. So I cannot say in the next six months.

A

It's the multi node till now has not had like a great story to for us to support, but we start to learn that actually there are stories for it. The so you're still not like the main stories of testing kubernetes and try, but they are and we we have it on the roadmap and as the long-term priority.

A

Any other questions all right, that's it! Thank you so much.