GitLab GDK and Gitpod walkthroughs, 8 Dec 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: GDK for Auto DevOps

Description

Tutorial for using GitLab Development Kit for testing/developing Auto DevOps

Related issue: https://gitlab.com/gitlab-org/gitlab-development-kit/issues/698

A

Okay, so this session is to discuss using gitlab development kit for people working on auto dev, ops, so happy to have Tonkawa let senior back-end engineer from gitlab tongue. I'll turn things over to you and then go ahead and take it away. Cool.

B

Thanks ray, we also have here tiger as well, who is also significant engineer from my team as well, and he's also Judy key means in it too. So today's session is going to be just going through installing GDK, specifically to test and run outer DevOps. So for those who'd inner outer develops as a quick intro of the DevOps is a set of template pipelines that has developed there. That will allow you to build test and deploy to kubernetes clusters, so it beats. So.

B

The two main components is that it builds some docker containers and the new deploys to kubernetes clusters.

B

So with regards to Gil app development kit, and the main thing is that we need to basically make the the GDK instance accessible to the Internet so that the communities cluster can talk to your can talk to your local instance, because, because the default mode is set in local hosts, which means that the account of the instance so I've already kind of run through a few things already, as you can see on my screen, so basically we assume we're going to assume that Gil epidemic it has been set up.

B

Already on on the machine, so the steps that are untrue just quickly is that non-intuitive preparation, which is just installing all the dependencies and then I've, run through the setup, which is basically not that one. But this line here JDK installed a killer. Repo I had to do this prior because it takes a while to clone the repository which takes about 500 megabytes and also takes a while to install the dependencies. So you can see some some things. That's been run here so now that we have it running, and this is the local host machine.

B

The next step that we can try is going through this handy guide here to configure.

B

So there's kind of two flows here: one involving get that team members where we have access where the levers provide access to a jump box to tunnel traffic to from the Internet to your to the local machine. The other option, if you don't have access to this kind of jump ox, is configuring your own nginx proxy involved so that you can tunnel Internet traffic to your local JDK and that's in the bottom of this development dock yeah? So what we're gonna grant you is we're gonna run to the one involving the jump box.

B

Cute Hannah, so I've already had this so previously, so next step, I'm gonna do is run so I'm in the GDK. We're gonna run this few things.

B

We don't here, it's just saving some settings, namely our DevOps enable so that tells GDK that we want off DevOps and what GDK will do is it will configure tool tunnels that can to funnel an internet traffic into your knowledge? It's.

B

Telling me that I mean something has changed and it won't apply this. So what I need to do is remove this.

B

Configure King just following instructions, so by default GDK will not all right. Your yah morphs that has generated just in case you have manually added there are false, so I know is that I just allowed judicata conflict Lee. We can't leave it.

B

Okay, that's fine! So it's finished that but I'm I note and had a warning day again. So, instead of kind of reconfiguring again, what we can do is we can follow instructions, and just so we make that specific coupons. They are running reconfigure all over again, quick.

B

If I look at a proctology bottom, you can see that it has created some tunnels as well, fantastic. So after after we run GDK reconfigure does this message here, which is really handy, so it tells us that it has donated and configured Duquesne's and such that these two URLs are no accessible intimate. The main address is really the gilliam instance, which is which was the interface, and this here is more useful for for the humanist classes to fetch kind of container images from from that, so it has.

B

So that's what enabling registering- and this registering any vote that's, but we added of this or completely configured for you. So most of the time you don't have to so. If you can now go to the browser and.

B

Yes, it won't have it so I'll cost, because UDK is not even available.

B

Oh I had a previous judicata instance, so.

B

I'm not sure what's happening there with no such factory, but we can kind of ground judicata to figure that one.

C

Time it'll be alright, it just takes a lot of startup.

B

B

So yeah it's doing things.

B

If I refresh this is no charge Rose, what that looks, terrible because it started to Union gone boom. Our workers.

B

That's that's an interesting error message. That's that's! Not an error message that I'm used to I'm, usually saying you can't connect or something like that. No such file or directory.

B

Owned when we probably hope it to a large I'll, ask it.

B

So I kind of forgot to mention like why this is useful teams, so I did I mention that is it's useful for kind of useful for Cuban artists to access.

B

B

And but really it's doing two things really if I as far as I know and I go favorite age company as well. One is that that the Cuban heiress, the runner.

B

In Cuban, edits can register itself.

B

The second thing is that Cuban artists, ports can fetch images from your local.

B

B

In any reason why we need this by the way you know tiger.

B

Are you mutant, I.

C

Think, that's all that's the normal reasons. Okay, I guess it could help if you wanted to share what you're working on with people that weren't local, but this is all forgiven. It is yeah.

B

Yeah for then we have review apps, isn't it so because you know when we run a CI pipeline.

D

B

You're, a guillotine member, our CI pipelines will spin up both there are yep you can share with everyone, so this is. This is really useful. 14 for people develop and test with ops, I guess.

B

Kind of teams groups would be teams, groups will Connolly, is those things would be figure.

B

So just other kind of Summit engine instead then have have configured the outta time of slow for that. So that's all done. That's great! So so I think we are all locking just great so I need to login with a default password which I can't remember.

B

If you remember the default password, you can find it somewhere project overview, I.

B

Reckon that's the default password.

B

B

Great there we are stuff I reckon we should try kicker Steve, and he goes on discs that make sense.

B

Ok, so let's see do we want or unknown of these things run the integration tests yeah, maybe not so little quick demo instead of writing out the DevOps locally.

B

So how do I do that?

B

Let's make a new project.

B

In for a mini Malibu, yep.

B

B

B

So the next thing that we need to do is create a.

D

D

So, let's follow that next thing: you need to do.

B

But the next, so what we're currently doing is setting up the OAuth tokens for Google so that we can create use the existing integration to create a new cluster on GK. We create a credential and we say off client ID,.

D

B

Really good a consent screen I, see I'm in the wrong thing.

D

B

Authorize JavaScript origin, and so we need to follow the Monday we have, which we can get it from yeah. So it needs to be HTTPS Cayetano, which port.

B

This is the Gila port. Isn't it not a righteous report? Am I right, I know correct Thanks, then so authorize, JavaScript, origin.

D

D

Did anyone just copy.

B

The whole thing here he's dead in and then port is 2 for 9 to 5 enter okay, that works copy differ.

B

1909 2005, so basically we need to acquire this far off to work anyway, clear.

B

Why it takes that long.

B

Simply getting stuck here, oh.

B

It's reaches maximum.

B

Probably reuse some other credentials, I guess.

C

There is a shared application that has lots of them and that you could probably get it to me.

B

Do you know which one Tiffany shared if you go back to the list, yeah I'm, looking at a list.

B

I'm, just I'm kind of not showing it right now, just in case.

D

No, not that one no.

B

Doesn't matter, I can use Tigers one there we go tiger def, see.

B

Yeah I can't show it because it's got a client secret and I kind of don't want it too sure so, but I can certainly edit to take a test. See that's alright, yeah.

C

B

Okay, so basically, we just enter 2 for 9 to 5.

B

And then so, basically, what we're done is that we've entered those these two lines into existing of client ID and then what we need to do next is echo those things into that. So.

B

So in here we can go echo that into.

B

Nandi client secret will equate someplace else.

B

But I'm I'll show you the file name later on.

B

So we just like go in that really.

D

B

Basically, just I could this is one which has declined sick and then what we can do is we can.

B

Okay, that's real estate clients. You could do probably deleted after this.

B

D

B

Complaining that we need to apply these changes so just need to do this.

B

Got that so we just regenerate that so that we get our off talking off into our demo.

B

D

Cheetah cheer restart as well.

B

No, we shall bear to create GDK a new GK cluster for my Gillette meant again. That's.

D

B

Know does say it does say socket no such file directory, but the key to key really is to wait two lines. You see the arrays wet, say step. We already know, and it's quite a to workers takes about two or three minutes.

B

Well, any Buddhists do have any questions.

B

B

Sign in again, that's okay.

B

Pea project, which already has all the pre-work, is the API stand owned and select somewhere closer to us to my current location, so that it's faster to upload images and whatnot.

B

The reason why I selected a minimal groovy app instance by the way it's because it's I mean it's minimal, but at a resulting image that it generates it's much smaller and one reason why it's much smaller is because we have a dark space.

B

We are using a line which is much smaller than a default of DevOps. The default to devops uses Ubuntu based container, which is about 4 to 500 megabytes long.

B

B

Yeah CSE's that's using helping.

B

B

So creating learning clusters take the while in general, but I'm generally GK is actually the fastest in creating clusters. It takes about five minutes to create a cluster, takes even longer on other platforms. Well, I think it is a work in progress for me where we can improve such things.

D

B

We're waiting for the cluster to create: let's go it ain't, disabled, some jobs that we know it's gonna, take a long time so buddy for all the DevOps, quits whole series of jobs and one of the test jobs they create is good quality, which uses the code climate engine to verify, to kind of check the quality of the code and gives you various reports, and fortunately, that takes several gigabytes off docker images to download.

B

So we're gonna skip that because we're short and you can skip that by setting the code quality, disabled key and just some true ish value. One is fine still being created time ago.

B

I'm not sure do you know, then, if this is necessary to ever internet accessible. This part I, don't think so.

B

B

Sunny its own, even if we install the run yeah the running, is to once after install it in its register back so the minimum that I need is home, tiller, ingress and run because I haven't configured any runner, so I need I need a runner in an ingress. You requires so that your app has an IP or domain to connect to.

B

Well, go ahead and install both ingress and runner.

B

Primus install an ingress is installed as well. It's getting an endpoint.

B

Genentech young.

B

The thing that I find amazing about this is that um it consistently gives you your ipv4, endpoint, I, guess: Google has a lot of ipv4 addresses to give up.

C

Repeat, oh really,.

B

Interesting yeah, you see in the latest news that region region have running our ipv4 okay, so what we can do is we have that we just configured that as the base domain for clusters, so this will go ahead and tell al to DevOps that this is the domain. You one for your for your Cuba nearest cluster and after that, once we also generate a domain for you with this, as the base domain, so it'll be like project named okay, so we have to the cluster setup.

B

So the very last thing we need to do is run a pipeline or I'll commit something in a pipeline will get created for you, but because we're 4d creators or the color ID, that's necessary, we'll just run a pipeline manually. So she ran a marina, quick flying right now.

B

It will quit the default of the DevOps pipeline, even though we don't have a gillip CRM. It will show the job in a moment.

D

C

Guess it's worth mentioning the reason this is so slow is because there, where we're currently located, is very far away from the queue a tunnel box. So it has to do a lot of round-tripping.

B

Yeah, that's correct and also we where I'm, Connie and I know the internet connection is okay, but upload speeds up. The speed and I'm on is trottle. So the main thing really what the main slowness here is. Maybe we are uploading trying to upload a 10 megabyte javascript file up to the QA tunnel and and then takes like a much shorter, more time to download 10 megabyte file really, and that's because my upload speed is 10 times slower than my download speed cook and, as you can see, is created for jobs well to Devils.

B

You build test production, so bill will build a docker image and you test the dock. We test a resulting docker image and then production will push a home chart by default, using the docker image that it has and Cuban Aires would then do its thing to pull down the image so that I can start the ports, so I think I think we're kind of all the time. So I think this is a good place to start really who thank you very much. Thanks.