Kubernetes Kubernetes Contributor Summit - NA (San Diego) 2019, 27 Nov 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Contributor Summit NA 2019: Setting Up and Running Prow on Your Dev Machine Part 2

Description

Learn about the Kubernetes project by testing your contribution locally using Prow before you submit a PR.

Event link: https://events19.linuxfoundation.org/events/kubernetes-contributor-summit-north-america-2019/
Session link: https://sched.co/Vv9P

A

All right., thank you. Everybody. appreciate the help.. Thank you so much.

A

All right. hi,, I'm chris short.. If you didn't remember me from this morning, uh,.

A

I work at red hat.. I am also a kubernetes contributor and cloud native ambassador. uh,.

A

This is the beginner session,, so you know how to use get and you know how to use go and you know how to check out kubernete's and you know, work with docker. you're in the wrong place.

A

Go over there. uh,, but I think we've got that figured out. all right,.

A

So yeah. uh, this morning we're going to do real, quick, overview.

A

Uh, 1230, we're breaking for lunch,, so we're going to push hard at this afternoon.

A

we're going to do a bunch, more fun, stuff., all right,.

A

So the architecture overview. mmm,.

A

I'm going to talk about this very briefly.. It is designed to be a simple image.

A

Essentially, you have kubernetes nodes., those can be vms,. Those can be,.

A

Um, bare metal,, whatever you want to run it on., they have a control, plane.

A

The kubernetes api, uh, applied to them and they can't be managed.

A

The nodes can be managed with some of the kubernetes. Api is actually,, which is fun., and then you have client, libraries or ui curl and kubectl.

A

Or kubectl,, however, you want to say that. um,.

A

Those become object, definitions into the api., so pretty simple, like input workflow for kubernetes.

A

Um, but there's a lot of machinery behind it,.

A

So some more of that machinery imagery right, here.

A

If you need to use persistent data,, there's a thing for that.

A

If you need to use, um, any kind, of, uh,.

A

Network policies or security policies, there's options for that as well.

A

Don't be afraid., it's not as intimidating as it looks.

A

All right, so [inaudible] kubernetes org.

A

We're going to do a basic repo tour here and it's going to be awesome cause I'm.

A

Going to have notes over here somehow and we're not,.

A

I apologize. okay. and.

A

I really wish I could see both screens at the same time, somehow.

A

New tab. yeah. yes. okay.

A

Anything? nothing. all right.

A

we're going to just mirror the display, then to hell with it.

A

All right. w w hello? big screen.

A

All right., so this is the high level kubernetes are yet,.

A

If you notice, the main pendra repository has kubernetes, that's where everything pretty much lives. mmm.

A

There's also community repo enhancements., the website itself,.

A

Everything's in a repo., every sig has its own repo,.

A

But most of the kubernetes code base lives under kubernete's.

A

So let's go into that., so you will hear this, uh,.

A

Get hub.com, kubernetes, slash, kubernete's referred to as k, slash k in the community.

A

Quite often, if you see k, slash, k,, that's what they're referring to is this organization, or this get a repo. um,.

A

So the main sections that we're going to touch here, cause. I have to pull up my notes for this cause,, so you will see all this to,.

A

Uh, build super important directory, right?.

A

So if you want to build kubernete's,, everything you know is in here, um,.

A

Including all the pre-recs., so if you are working on kubernetes,.

A

Like the actual code base, come here, first. make sure you've read up on this.

A

There's also a contributor guide, um,, that's in the community repo as well.

A

That was linked in the slides, earlier. uh, that,.

A

That's like a checklist of how to get started.

A

But when you're building kubernete's start here, first. [inaudible].

A

Uh, the command., so this is the cli library. um,. Let me,.

A

Sorry,, let me close this.

A

So all the cli tooling for kubernetes is under these directories. kube, adm,.

A

Uh, kubectl the kubelet itself, uh,, all the,, you know,.

A

Cli tooling's right there for it. that all lives, here.

A

Um,, so if you're interested in improving, uh,.

A

Cu cuddle, outputs or you know,. You want to add some functionality to ku,.

A

Cuddle itself, great place to start.

A

Okay., they call it code from package,.

A

Which is here. so the package directory, uh,.

A

A

Told this is the code core essentially.. Are you good at this?.

A

Do you do better what?, repo walkthroughs? and I do cause I'm terrible.

A

we for a walkthroughs. um,, so all the, uh,.

A

So, let's look at kubectl., there's a command itself.

A

There's the docs, build files, everything you need right, there.

A

But there's all the kook cuddle code right, there., that's it.! That's it.!.

A

It's a lot of,, it's a lot of lines of code. but don't be intimidated by it.

A

You can get to it. it's right. There. [inaudible], hmm., sorry.,.

A

Staging. okay,: let's go to staging.

A

Everybody?, you can tell me no.

A

Okay, one thumbs up. I'll, take it. okay.

A

We're staging., where am I? okay. kay. becky, go ahead.

A

Staging. [inaudible].

A

Okay,, so the external repost agent area is here.

A

This'll tell you where to go to find where all these various rebos get pulled in.

A

To get actually built. um,, as you can see, like, oh, sorry,.

A

Clank go gets pulled, in., uh,, the cuba itself, scheduler,.

A

Everything gets pulled in to staging for build, uh,.

A

Instructions for using it, adding things to staging. everything is here.

A

The one thing that we are trying to work on very hard is getting the.

A

Documentation that doesn't get hub exposed better..

A

So if you have ideas around that,, I was talking to somebody earlier,.

A

Let me know because this isn't easy. really found,, that's where we have to do these code walkthroughs., so silicone project,.

A

Everything's in get hub and it's hard to expose things and get up. we're finding.

A

That's where all the api code lives, or at least the, uh, rules, for it is that,.

A

Does everybody knows what a owner's file is and the kubernetes world,.

A

Good hope, world. no. okay.. So let's talk about owners for a second.

A

Owners files are essentially who can make changes, who can, um,.

A

Do things with that particular repo., so, um,.

A

There are groups that we create to help manage that. um,.

A

But there are reviewers and approvers generally speaking, right?.

A

So you pushed your first pr and you say, hey,.

A

I want to make this change to abi code., I'm a reviewer for that organizational unit will have to come in and say, hey,.

A

This looks good to me. I'll have to pass all the cia checks. um,.

A

Typically, two reviews are necessary for most, you know, changes. um,.

A

And if it requires, like there's rules around when you can just make changes.

A

And when you actually put in a kubernete's enhancement, uh,, a cap,.

A

What does the p stand? For?, kubernete's enhancement, process., mmm., so,,.

A

But when you put in the pr, the,.

A

The reviewers would have to come along and once it's reviewed,.

A

They then request an approver, like automatically. We have bots that handle this for us, because we believe in.

A

Automation. so once an approver comes along,, the pr gets approved and off it goes to cii, it'll, eventually get pushed out to the real world, uh,.

A

In the next build and release. so yeah, like your,.

A

Just a few steps away from having code committed to the kubernetes code, base.

A

Not look a big leap to become a contributor., it might seem intimidating,.

A

But you shouldn't be intimidated by it. all right.

A

Clusters., mostly deprecated docs., just kidding.

A

So, okay,, so docs are interesting, right? um,.

A

So we pull all the docs together.. We have a doc, a build process that builds an actual like docs website.

A

And I will show you that now, because it is very cool.

A

So if you go to kubernete's,.

A

The repo thing. [inaudible].

A

Rules get pulled, in., cool.

A

So kubernetes website.

A

Okay. so this, uh, the,, all the docs are a website.. It is,.

A

Is everybody heard of the static site, generator, hugo?? It's written and go. mmm,.

A

Super easy to use tool are basically parcels marked down in terms of going to a website., so we adopted a hugo uh, earlier this year or last year,.

A

I think that'd be pushed it this year,, but we adopted it last year. yeah. um,.

A

So all the documentation actually lives in a repo that generates the website.

A

So if you get a pr approved here,, it's going to be live for everybody to see pretty quick. um,.

A

The website gets billed a super fast hosted on netlife iso. Thank you.

A

Net will fi um,, but there's also reading these various languages, and this is where we need a lot of help. Too., if you speak a foreign language and do you see like a grammatical error or.

A

Something like that and you're, you know, one of your native tongues,.

A

Please help. uh,. If you see a language that is not represented and you feel like you could get a.

A

Group around that, that would be super helpful, to, uh,.

A

I have many friends on sick docs just because I've met people that are.

A

Interested in writing, docs and then said, hey,. Here you go. like,.

A

Here's your people, sick, docs., um,, super easy way to a get started on kubernetes community and be kind of learn.

A

Your way around how things are done.

A

so when everybody says start with docs seriously, like if you find a typo, that's a good repo. like that's a good change.

A

Commit that, submit a pr, it'll walk you through the whole process.

A

Yeah., including how to build the site and tested locally,, which is awesome.

A

All right. and then test. so test and fra is relatively new,.

A

Right? working group test infer is this year,.

A

But basically, uh, yeah,, so all,, so all the fun stuff, right?, like all the cii,.

A

Everything that gets built in the background that you don't see, that checks all your commits and your issues,, your pull requests, all that stuff. and then actually all the testing against the various, uh,.

A

Supported hardware and architectures all happens through test end for,.

A

Or yeah, all happens through test in front, and that is not under a k. k.

A

A

Can we do it? there, we go. all right., so kubernetes test end for super fund group.- uh,, if you're into infrastructure at all- and I'm talking like managing servers,.

A

Ppcs network, stuff, like that,. Please join this group.- uh,.

A

I tried to help this group as much as I can, because I have ops, experience. um,.

A

This group is kind of like the dev ops team for now. um,.

A

Like the sre team for the actual kubernete's, uh, like back end, build processes.

A

That's where test for live. uh,, it's a big group, uh,.

A

Because there's a lot of people willing to help,, which is awesome,, but it takes you through the entire test. Process. uh,.

A

There's all the documentation, you need to know about tide and prow and all the.

A

Fun tools that are part of,, uh,, our automation and including all the other, various tools that go into a work.

A

A

So we are, it's kinda,, you know,, as you saw it, was pretty monolithic. um,.

A

You know, kk,, we are breaking it. Up, right?, like testing for as part of that a community is part of that breakup. right.

A

It was very monolithic repo.. What we want to have happen is actual kubernete's, like api code, only living in.

A

Cake, cake, everything else needs to be corrected.. He slashed the thing, um,.

A

Or the sub project- and that is just so kk- is easier to manage,.

A

Right? like if you cloned it or you, forked it and you cloned it,,.

A

You realized it took a while., it's several gigabytes of data.

A

We want to make it smaller, more compact,, so more segmentation,.

A

More partitioning through, uh, get rebos essentially.

A

I'm next slide. back to the deck. full screen.

A

All right. yes. question. sorry, eric,. Let me go.

A

What about all the other parts in the make up kubernetes at cd, that you.

A

Container run times,, I guess they're, not in kk on, they're, just managed,.

A

But separately. are they similar and how they're managed or is anything worth saying, there?.

A

Very good question., where does that cd come in?? Where does things like, uh,.

A

Your run times like cryo, oci compliant builds, uh,, the docker runtime,.

A

Everything else,: where does that all come into play?? That's all part of that, uh, stage.. So when you start pulling in all its, you'll see,.

A

You'll, eventually like understand how this kind of comes together.

A

like you, do a go: get, um, and you start pulling in all these dependencies.

A

That's where it comes in when you're doing those bills. um,.

A

You've done that before, right? at war.. I've never actually done like a full compiled kubernetes until today.

A

No. yeah., so it's like,. It's not a very common thing that people do to be honest with you. um,.

A

But you need to be able to do it if you're actually going to be committed against kk or any of the other working pieces.. So in generally,.

A

Generally, speaking, you to lots of ram and lots of desk, lots of cpu. mmm.

A

So you have to run docker, uh, to make mini cube, work,.

A

Which is what we're gonna use today.. You could use kind, uh,.

A

We actually had a commit this morning. uh,, thanks to tim hawkins, to reach out to ben, the elder. uh,.

A

I had to make a commit to make it kind of work. Today. uh,, you need go on 13.

A

Does everybody understand? go like how that dependency tree works,.

A

Go pass everything like that? no. okay, cool.. We can get into that.

A

Mmm. get hubby., everybody had to get up account., everybody have ssh keys, there.

A

Everybody have. mmm., kubernetes, forked and cloned,.

A

Pulled down to the laptop at least no.

A

And he knows no as well now.

A

A

Did everybody hear that? get clone the actual repo a dash dash depth space one.

A

So yeah. super helpful on crappy conference wifi.

A

One 16 three is what we're working on.

A

Okay. resend, the previous comments., I think it's, yes, the strike from the record. um, anyways. okay.

A

So does anyone not have go installed?.

A

Okay, cool. let's,, uh, darren,.

A

Can you help with that? got it right, there. uh,.

A

Golang.Org just download it for your, uh,, os and you'll be good to go.

A

All right,, so this is kind of at your own pace. did,.

A

Did everybody get the slides in advance? yes. no. maybe?.

A

No. okay., let me figure out how to share the slide. Somehow.

A

I believe so. okay., so,, oh, sorry., all right.

A

They're going to do a number of things: here. follow the instructions..

A

If you need to copy and paste from the slides and you don't have them,, let me know., I will get you access to them.

A

Okay, cool. um, is everybody in the new contributor summit or the ncw flack?.

A

A

so slack that decades that io [inaudible].

A

Please join that.. If you need access to the slides,, they are in there.

A

So if you notice, uh, you're going to do a go, path.

A

So if you don't have a go path set up,, you will have problems making and building code here who does not know what a.

A

Goat is and would like me to explain it, because I will actually pull up a.

A

Reference piece for it cause it's hard to explain.. That's fair.!

A

You don't know where to go past this..

A

Does anyone want to explain what a go path? Is?? You want to.

A

No, no, no, no. I,, I think, uh, I,, so I'm an ops person.. I do not,.

A

I write go code,, but not on a regular enough basis to be like a good teacher of goes.

A

Specifically., so what is the go? Path, sir? also,.

A

Who are you and where are you from? jeff dodo. um, uh, from comcast actually.

A

Um, uh,: what is a go path as a question? um,, I guess it's the path for your environment to tell go where you're source.

A

Yeah. so, uh, the go path,.

A

Do you want you, gonna go for this? okay. um, go path, is a go, uh, idiom.

A

Essentially, uh, need to have that environment variable set because go,.

A

I think defaults now to uh, toto for your go path,.

A

But that will be where all the packages for dependencies, all your source,.

A

All the binaries, everything will live under your go. Path.

A

So if you have go installed and it's a modern version of go,.

A

You should maybe have a go path already set up. um,.

A

If you have installed, go more than I think a year, ago,.

A

It might not be set up by default., so latest versions of go should use a default. Go path.

A

So please feel free to run through, uh, these commands.. If you have issues,.

A

Please raise your hand. um, yeah,.

A

I don't think the depth flag is a good idea. Here. sorry.

A

A

No,, it should be like a tag. okay.

A

So slides are wrong., so get checkout. Tags,.

A

Plural or singular tech, minus t get checkout minus t a v one dot 16 that three.

A

Is the last one that you need.

A

Any issues? any questions, concerns?.

A

Okay,, so I just keep going.

A

Okay, so get checkout, dash t.

A

Space v one.one six dot, three enter.

A

Did that work?, I didn't, do it just now. I can. yeah., so.

A

Okay. issues darren? nope., okay.

A

If you don't mind, I'd like to continue on cause, we have lunch and 35 minutes.

A

Any, any objections? okay. all right.

A

So container images, you're going to need some docker containers.

A

Luckily, we set up a harbor box and the room next door,.

A

So these should be pretty easy to pull down.

A

Again,, if you need the slides to copy and paste, go grab him from slack please.

A

Or I can share them with you, directly. assuming you have a gmail address.

A

Any issues with the harbor box?.

A

A

Just a show of hands. who's using linux? like as her desktop right, now.

A

Okay, cool. yeah. and then like two or three people, right?.

A

Who's using windows right now?, anybody? no. okay,, cool.

A

So max with vm. wow.

A

A

Yeah. oh, there we go.

A

A

Yes., what am I doing? Now?

A

uh, now we're going to break it down bugging.

A

You're in charge, george.

A

A

So if you notice the docker poles going slow,, I'm sorry. um,.

A

That's going slow for everyone. uh,. Let me see., I don't know.

A

How to talk to the kubernetes community and automation. yeah., so like,.

A

We've got plenty of time to debug issues here,, so don't worry.

A

like if you dropped in all the docker poles, it'll just keep going.

A

Yeah, yeah, yeah., so each image.

A

All right,, so all these images are for.

A

Building kubernetes locally., if you notice,, you have at cd, you have,.

A

Uh, ip tables, hyper cube,, some dbm base images.

A

That's all used to just build kubernetes right there on your laptop.

A

Do we need to have all of them if you're going to dev against it? yes.

A

It's just taking a long time in it., oh, you're, trying to do,.

A

Does anybody have in to have docker for mac already on their machine and like.

A

Could just transfer it over to my friend here.

A

Maybe like airdrop., I don't know., it's a 700 meg download.

A

You're going to be here all day.

A

Uh,, so it's a dmg file.. You can airdrop via like the finder.

A

Like you would have to turn it on. you'd turn it on and off you go.

A

Well, nah,, you have to do no. okay., I'm saying, hey,. I had the download.

A

A

A

A

So slack, that case that I own. oh,.

A

A

Yeah., what's funny is the [inaudible].

A

A

So that's the thing I said.

A

That's great. yeah.

A

No, no. okay. mmm, no,.

A

I don't know. yeah. yeah.

A

All right. no ma'am. [inaudible] right.

A

A

A

A

So that's what the remote is. [inaudible] [inaudible].

A

This right? shut me up.

A

Yeah. yeah. darren right, here.

A

Checking out of bed. get checked, out. [inaudible].

A

Yeah. site. okay.

A

Know [inaudible]. yeah,.

A

No,, that's fine., yeah. no.

A

Good. and then what were you like an? What are we going to.

A

Okay. [inaudible] dead.

A

So did you can, okay.

A

A

A

Love it., yeah., yeah.

A

A

A

A

Oh, hello? no, no. my ils.

A

A

They're online.

A

Actually, just the docker born in the pack. yeah.

A

A

Yeah., that's what, yeah.

A

A

Around a week,, right? oh.

A

Yeah. you get along.

A

A

A

Wanna verify your account now. you know,.

A

I mean we can't,: we've got rules about that. yeah.

A

You're going to get [inaudible].

A

A

Yeah. [inaudible] yeah,.

A

No. [inaudible].

A

A

A

Mama. hello? [inaudible]. Why.

A

He left [inaudible] yeah,.

A

A

A

A

Yeah. [inaudible].

A

All right., so what does each package? Do? uh, you've got a base image, there, dvm,.

A

Um,, that's just, uh,, you know, a lightweight arm or amd 64,.

A

A base image for dv. and you put hypercube on top of that.

A

A hypercube handles the what?, never clear.. I think I forget.

A

Um, ip tables,, critical part, of, uh,.

A

All the segmentation functioning inside communities. mmm.

A

Node. oh,, that's kind kindest. is that ben's thing? yeah.

A

So that's kind, a kind is kubernete's in docker?.

A

Yes., that is an old version.

A

So I have the version history up to get the old urls,, so I'll fix. That., hang on.

A

All right. sorry. better. thank you. uh,.

A

Yeah. and then cube cross,. I have no idea what that does.

A

I don't know what that does in the build process,, but you need it. um,.

A

Feel free to google it and tell me, I'm open to learn in here, uh, etcd.

A

Does everybody know what etcd is?, who does not know what etcd is fine? If you don't know., it is a key value. Store.

A

It is essentially the state for kubernete's database., uh, the,.

A

So if you lose etcd, you're screwed. you've lost your entire configuration. uh,.

A

So it is vitally important that you back it up. and there's lots of backup tools for kubernetes out there,.

A

But this is the, uh, data store for all the internal settings for kubernetes,.

A

Including any number of settings are very large etcd clusters running very large.

A

Kubernetes clusters right now.

A

Uh,, you can do three,, that's fine.

A

I can fix that. and then so. Cat is a, um,.

A

It's a socket like cat tool, essentially, is what it stands. For., um,.

A

It opens the socket and it just basically takes whatever content you give it so.

A

You can fire things at an open port and it comes in.

A

Yeah., hang on,. Let me fix this version. Number real quick.

A

So what does this tell us?? This is a large project, right?.

A

There's lots of dependencies because there are so many layers of attraction that.

A

The joy of kubernetes old version coming right, up.

A

Now folks, listen to,! I am opening an old version to find the old uh,.

A

Urls. do not use this unless you are connected remotely.

A

I think it's harbor.k8s.dev. yeah.

A

Harbor. k8s.dev is the external name.

A

There is an internal server set up in the room next door running harbor to pull.

A

Down the images., this is where you get them from on the internet,.

A

But all the version numbers are wrong., so just swap out the domain names and you're good.. So instead of,.

A

Uh,, whatever it is, go, harbor or contributor dot.

A

Go harbor did io., it is a harbor at k8s., dot., dev.

A

Any confusion? I hate confusion., I hate being confused.. So if you are confused,.

A

Please let me know., I want to fix that.

A

So the expectation is that this is going to take time, right?

A

like you'll, be pulling down these images through lunch., not a big deal. sorry.

A

I have no idea., I don't know where even mind,.

A

I didn't build that box., so please try and use the local ones as much as possible..

A

I don't know if that thing is even online to be honest with you.

A

The old version., so let's see., live troubleshooting.

A

A

What's the old url? anybody can be alert. mueller.

A

Was it k8s that go harbor.dev. k8s at harbor.

A

Not to have anybody.

A

All right., so I can't even get a dns pool from the old address..

A

So did you have luck? okay,.

A

So those boxes- down. yeah.

A

So please use the local box., it will be slow., it will download through lunch.

A

Hopefully we can continue after lunch. is that cool with everybody? yeah,.

A

Just dropping all those docker pool commands and let her rip.

A

Hopefully., hopefully it will eventually be consistent.

A

And I should look up what a hypercube does.

A

Well, I've learning,.

A

Yeah, great assembling or whatever. so, uh,.

A

People with go problems like you go path, isn't where you want it., so,, uh,,.

A

In newer versions of go,, it's a false to tilda home slash, go whatever your home path, is.

A

So I actually use that as a sim link to whatever I put my github repos.

A

So it kind of creates consistency. mmm.

A

So you can point home, slash go to wherever you want using a sibling.

A

All right. who wants to know what hypercube is? it is an all in one binary for kubernetes server, components.

A

It is built for multiple architectures and the image is pushed automatically on.

A

Every release. wow.

A

A

All right,, so it is 1230., feel free to break for lunch, grab food,.

A

Let your docker poles run., no concerns about that.

A

And we will reconvene here at.