Continuous Delivery Foundation CDF Twitch Channel, 29 Sep 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Twitch Stream number 6 2020-09-29

Description

Adam and JJ continue to try to get Jenkins-X working on Minikube.

(spoiler, we don't and run out of disk space)

A

And we're live, how you doing adam.

B

Hey very good thanks how you doing jj pretty.

A

Good pretty good! um So where are we and who are? What are we doing.

B

Okay, so where are we uh I'm? Currently, um I think you are as well and what we're doing today is playing of jenkins x and basically, the last time we tried to stream this. It was an absolute nightmare. We had issues with uh mini cube and because of those issues, we're very rurally uh dead in the water fixed those issues based. I did a brew install virtual box over again and now I have a working manicure cluster.

B

I have the latest version of jenkins x3, which is an alpha. So if this breaks, I won't be surprised if it works, it'll be great and I basically want to try and get the tech on through jenkins x as soon as possible. On my mac, that's where we are. What do you think about that? Jj.

A

That sounds great, but uh before we go any further, who are you.

B

Who am I so I'm adam roberts? I look ibm's a software engineer. I have a talk at cdcon in a couple weeks time. Please check it out. uh I work on techton here's his latest secret project.

B

I've worked on apache spark node.js microclimate gpus for java various offerings in the past and right now, I'm on yeah secret project ibm. Who are you, though,.

A

uh Yeah hi, I'm jj, I'm a developer advocate for the ibm cloud and uh I'm I'm helping adam tell this story uh via via streaming and uh we uh we're we're having some fun, which is all that really matters right.

B

It is it's all it matters if make some progress as well. That would be great.

A

Yeah there you go so uh let me go ahead and flip it over from um us talking to showing off your desktop. uh You might want to make your text just a little bit bigger before I flip it over.

B

A

I think that looks better. Let's find out.

B

That's huge to me: that's like size, 72., how's, that looking.

A

Yeah, I think that looks pretty good. I think that does only pretty.

B

A

Oh no! No! No! Actually, I was looking at the wrong screen um that looks yeah they're looking in the street, the uh the stream looks.

C

A

B

Should we get going yes, sir, okay, so jenkins x? Basically, there are two development versions going on the jenkins x2 checking his x3 now apparently jenkins x3 on mini cube, just might work. So what I've done already is I've set up my mini cube cluster. So if I were to do mini cube status, it says my mini q cube matrix cluster is active and healthy, which is great.

C

B

Currently pointing at it so my kubernetes context is mini, cube, virtually cube, ctrl custom info kci. For short, it would tell me I'm pointing to mini cube and I've got basically nothing deployed, so I have mini coop and I have jenkins x's cli at version three, so version of three is meant to work great on mini cube, it's this new modular design and you can use some cool things with it. Apparently, that's where I got up to.

A

Basically, all right all right hold on. I already have a question um being that you just proved that you had nothing up your sleeves yeah. If you go back to it, uh you are already talking to the default namespace when using jenkins x.

A

Do we talk to the default namespace or do we create our own namespace for it? I.

B

Got no idea, I think each team might have their own namespace uh and you need real get up stuff, but I might developed for drinks in two years, so I may be wrong. I've been surprised if you use a default namespace, though.

A

Yeah, it would be too.

B

Yeah, so I think we're gonna see where we get to now. What I've done already folks is I've done these steps. I've already done the object, getting jenkins x3 alpha.

C

B

The jenkins x3 cli, that's the binary, you can see here and infrastructure. I basically did this to get mini cube on my laptop, so I've run through these steps and it involves um sashing up mini cube. You set up a little git repository from a template and basically it stores some github's configuration, and then you, basically it says web hooks for van gogh. uh I will not be doing any of this. This is an ibm laptop. I think I'm not about to.

B

I think it's blocked, so I'm going to try and skip the webpage and just do manual build in jenkins x with text on with this template repo. I think I think that's something I do so. I had to see this weird step here. I had to set my domain to be my mini q by p address. So if I were to echo dollar domain, that's my mini q. By p, we've got nip.io, which does some weird dns resolution magic.

B

So and basically I've got no idea if this will work on that, I'm basically following the three instructions if it works. That would be great. So I did not do this. Didn't do this didn't do that and I probably need to do this. I need to push these changes somewhere. So if I do get status, um but let me just remove some drunk added uh git status. Is that I'm pointing at my template repository?

B

I don't know if it's got code in there, that's going to be, you know a known application or a go application. I think it's just full of like.

A

Configuration files.

B

Yeah, like miscellaneous infrastructure, things can.

A

You can, can you bring up that jx.requirements.yaml, real, quick, I'm.

B

Curious to see that so strongly got this stuff in.

A

hmm Yeah, this is all just configuration stuff.

B

Yeah, it's like projections x itself. It's not like an app that I'm going.

C

B

So I'm just going to do this, push um I'm going to call it config for mini cube and then yep. Let's just get brush origin master, so I basically configured it to use my ip address and if I show you the latest commit you can see what I actually got changed. So let's look at that. So it should be a new domain.

B

Let's see what else has changed? It's added some stuff, some documentation uh requirements.

B

They added this ip address and added some more config, dev and staging added. So that might be useful and yeah. That's that's cool! I guess, and then this bit you want to install the git operator. So it says here it uses a git operator and start upgrading, jenkins, x and anything else, my environment. So I don't think I've got genko's x installed in kubernetes like as actual pods look see, I don't. I've got mini q, but no jenkins x, parts.

A

B

I think you need mini cube or a kubernetes custom supports jenkins, x, binary and the chickens x itself, and I think this step installs jenkins x itself, I think so to install it. I need a pipeline user and token okay.

B

I can start a web post manually if I wanted to okay um and I can install the operator using jx admin operator, if I did it on its own, I'm going to tell you something I already installed the operator earlier to test it all works. It didn't work because of my networking configuration I basically had in this resolve.conf an entry for name server. That was on the ibm network and I wasn't on the ibm network.

B

So when I tried to install the operator it tried to get first to diagram network and then to github.com when it always timed out, because I'm on the vpn, the ibm network, I'm now on the ibm network in that file here it says usually yoga network and does like an inside operator.

B

So basically, I was like in this channel here saying: hey folks, what's going on help, and you know the community of drinking sex is very helpful. The game at some point is, um I figured it out, but thanks to james's new piece for timeout period, I got a better error message. I got this message here and it told me that the nine address was being used.

B

That nine address is what I've used for the ibm network, so good community to help me out, and I can now install plugins and therefore operators and it says that I need an operator so that'll be in the faq, eventually thinkers x. So I've already done this step. Folks, I've done the operator install.

C

B

Then it says I'll tell you what it looks like this this here. First of all, we'll install it. If you don't have it already and then get to use it. That's my guess.

A

B

If I do that command now, so gate clone url is adam cool, so he must have figured it out because I'm in that folder already.

C

B

I were to go to a different folder and then do an operator.

B

It tries to install helm, okay, cool, um I don't really want helm yet, but it's it's context aware so.

A

Did does it actually saying that doc to do this from your.

B

B

So now it says enter bot username, um okay, I'm gonna. um No, I'm gonna do.

A

It do the question mark for help.

B

Oh true, you're right, let's see the question mark right. Oh.

C

It synchronizes it into the cluster.

B

Okay, it's a cluster. Okay cool um enter the box, get user name, I'm gonna, put my own name in and knight wants a token.

A

Let me put some secrets up hang on.

B

Well, okay, I think it's already in my copy, but okay.

A

Okay, well, the secrets are up for now. If you want to click on that link,.

B

Okay, my secrets can go away. I think.

A

C

So I'm gonna, it's gonna, be my trying to hit the button when I can.

A

Trying to hit the button when I can.

B

A

The button when I was trying anyway, I was trying to make a joke, didn't work.

B

I was too busy looking at the screen to make sure my talk wasn't being printed. Thankfully, you do starve it out so good. So what this is doing is: let's read it: adding a missing home repo adds the home repo and then runs a helm, install of.

B

Jx3 jxk operator where's that coming from is that a helm chart in this repo by actually it's.

A

Gotta, be it's gotta, be characters yep.

B

Jake's blah, that's not in the same place, though jx3 ah hold on it added it added it added jenkins, x's helm, chart from this place. They called that chart repo jxt, then.

C

B

Did a helm, install of jxk operator from jx3 into the jx namespace and I'm guessing they've called the release. Jx go! So if this works, I'm gonna do a helm list and jx go. Should pop up in the jx go namespace and then I guess, do I have jenkins accident.

A

No, I'm assuming you do.

B

It says it will use sound from study operator which will trigger a judgement star drinking sex, okay cool. So I'm not a patient man. I'm not watching things. Do nothing. So, while.

C

B

Happens, I'm gonna. Do a qttl get paul's minus w? uh No, when all name spaces, don't I'm not sure where it's actually going so what's going, okay, jx is being created, cool.

A

B

So if I do k get pod minus single x minus w, I can basically watch that container because I use my w for watch. If it's.

C

B

Changes I'll see something happen now again cause I'm not a patient man. Why don't we get the logs for those? So if I were to do a two ctl get pods minus njx.

B

I think this is still creating new orders. We're going to get a logs on this. If I do k logs at pod minus mgx, let's see if it's complained yet.

A

Yeah, something.

B

Because I think it's still going on okay, it's still.

C

B

Creating have I got helen though he'd like to install helm for me.

A

Do do describe on okay, yeah.

B

B

Pulling gimmick: okay, it's pulling something, presumably quite big. I do believe if memory serves correctly well, let's get rid of this earlier on. Jx is github. I think someone complained saying uh your image size is quite large. I think I was looking for my timeout issue. I think I saw someone complain. So you see high image. Size is huge, 2.8 gig. What what so so folks I'm still pulling. I think uh how do you dock images?

B

I remember a minute. You've got to have some weird, like docker eval command, to make it point to your mini, cube, docker registry, so duck images may be misleading. This may be uh my real documentaries, not mini cube's images, but finally, with documentaries, jx, maybe.

C

B

I think it's because definitely like mini coo blocker evolved command.

A

Yeah, I think it's it's inside a mini cube, so you have to break.

B

A

Have to figure out the images.

B

It's something like this not used in three years. I think mini coupe. So, let's see if our mini cube document right so we'll do that uh they even press copy there. We go that's better.

B

If I need button images just on its own, I want to see if I'm pulling things.

A

You know grab for jax.

B

Yep, I don't see actually jj my eyes.

A

B

Usually quite observant- and I don't see it.

A

That's not good.

B

Well, maybe if it's not on your system, yet it's not in docker images.

A

B

Baby, so if I were to just drive on that part again, let's see if it's still pulling okay, it's still pulling for nearly five minutes.

A

You have to pull this from the other side of the world.

B

Maybe ah that's there's a progress bar.

A

Put that issue in in.

B

Keyboard yeah: well again, it's updating a field. I guess which is just events so yeah. We have to put a progress bar.

A

On that, uh on that issue, that says this image is way too big. You should say also a progress part would be really nice to have too.

B

Yeah, if I want to buy the progress, powered, go oh on the command over here.

A

Yep, that's not that's not our problem right, like just to say, hey this this as a as a ux.

B

Might come back to its issue and say yeah folks, it's indeed too big. What's going on! This is ridiculous. That's so big! So if I go to jenkins x over here, I wonder why it's so big what if I can find a docker file. If I go to go to file file, okay, it's probable folder!

B

So it does it's from jxci base.

A

I gotta go find that now.

B

Yeah and I've got to find jenkins x, I o j x. U I base only if that's under there's various repos in the b jenkins x umbrella- and I.

C

B

Drinking x platform being like quite important only if that's got a duck of fire on it, it doesn't okay, folks, so uh yeah, I'm still pulling uh the image for the operator. Oh, it should get operated.

A

B

Got to be a repo search, yeah first search for jx kit operator.

B

Okay, one repo result a simple operator, maybe simple, but it's not small- that that's.

A

Ten bucks, big yeah.

B

It's from that.

A

Point so big here change that go back, go back, quick, go back um change from get operator to get base or see like cli based see. If that's.

B

Right yeah cli base yeah.

A

See if that's a real repo oops.

B

B

So jxci bass, ah okay, bass, image- this could be the one from centos seven.

C

B

So that's why it builds. This will be a multi-stage shocker file, terraform and then from gohan 113 from wow. This is quite a sophisticated dockerfight.

A

It really is jesus.

B

Okay, so we do loads of things.

A

Oh, I bet it's the google sdk, that's probably the problem that thing's huge. If I were correctly yeah.

B

You're putting google stickers slim in there, I wonder how slim it is. If I go to backhoe I'm doing.

A

Seven seven gigs.

C

A

No, no I'm kidding I'm kidding.

B

That's eight gigs too many, let's see still pulling by the way folks one day, it'll come. So if I go to tags I'll see how big this slim one is.

B

Slim is season three or six meg. Maybe that's not the big, the big whomper, that's taking up all the room.

A

Does it, then it would be the go one.

B

Yeah, maybe so it was golden 113. I believe, let's see how big that is.

A

Isn't that an old version I go also.

B

A

Isn't that 113 a pretty old version of go.

B

Yeah I'm on 113. Personally, so, let's see 113 uh sure it's off the page into oblivion, either way it's probably only about 100 meg, give.

C

B

114 about that.

C

B

I am still pulling badly everybody.

B

uh It's been. I didn't wanna describe pod again in nine minutes of pulling might just find a broadband plan that was capped like one gig a month, I'd be royally, doomed.

A

Yeah, that would be like.

B

A

A non-starter right like.

B

It might fall for you know having a work environment with very low requirements, uh but it won't be very good with it, so they go and get kpi. They go and get various things.

B

Once we get this image, I'm gonna dive in there straight away. I'm gonna put my you know, diving costume on put some rubber gloves on. Do a docker exec into the thing I reckon. Let's have a look around because it's it's massive.

C

A

B

Whole might even ask.

B

What them might do, uh but even asking jenkins, x, user and just say, hi james. Why is it so big? So this is where people hang out for shrinkage x by the way. So this is the kubernetes official psych channel uh kubernetes.slack.com and there's a jenkins x, user channel and drinking sex dev.

B

There's a way to ask questions about. You know if you're a contributor, you might use this channel if you're a user like myself. Now you might use this channel. So you know there's plenty of people in here. There are three thousand folks in checking sex user. 6 dev has over 1 000.

B

So again, that's for satchmo. If you want help with jenkins x, I believe.

B

C

C

B

C

B

Well, I talk about yourself, I guess everybody yeah.

A

I mean that's, that's that's the whole story right like we're, trying to figure this stuff out, and if this is something, if this is a, what going to do is we're going to give these two videos to the jenkins x? People be like here's two professional engineers trying to use your software right, like so yeah.

B

So for so it says from center seven.

A

Where does mini cube, install itself yeah like maybe we can go see if the directory that mini cube's running from is getting bigger or something like that right.

B

Okay, oh true, so there's a mini cube, folder.

A

B

B

How about um ls, mass l.a, earthquake, hs or home.mini cube?

B

uh Well, I was gonna.

A

Dash sh dot mini cube.

B

Oh yeah yeah two point.

A

Nine you get the momentum take out. The h take out the h, yeah.

B

You want it in bites, don't you know human reading.

A

Yeah and then do it again, nope it's just stuck there she's, not changing. It's.

B

Done is it gone.

A

B

Describe command again, oh still, pulling after 13 minutes. So where do I look and just go really.

B

C

B

There's also, how do you make a tunnel.

B

Oh, it's quite laggy in here.

B

C

B

Obviously this is getting bigger from inside.

C

B

This will be an innuendo in this one, so it.

C

Is getting bigger.

A

Is your? Is your laptop okay, bring up an activity, monitor.

B

uh It's quite quite noisy at the moment.

B

It's very noisy it's getting hot.

B

All right, so uh it's up to some some good stuff. You know memory this. How about that network?

B

Let's do received packets, that's.

C

A

Vbox headless the vbox headless is the actual thing doing the job.

A

According to that, do you hear the mix.

B

um I thought I'd have uh more than that, because it'll take a hundred minutes. If it's been 10 minutes, it's too gig.

B

This is just going to be like a stream where we've downloaded jenkins x.

B

I think it might be. Do you want to give it a try, jj see if you can how's your environment.

A

It's all still jacked up. I haven't done the homework. I didn't do the homework okay, um but let me I'd be curious.

C

C

A

I saw my kubernetes cluster up. Let me double check because.

C

A

Like what I'm, what I could do is I could try to try. We could try to use my kubernetes cluster again and try to pull from there. um Try the jx admin operator.

A

If you want to bring up tmux hold on I'm still doing stuff, though.

B

Okay, I'm just going to put a link in to an issue about the image being so large just so they can get a discussion going.

A

A

Well, sometimes, you know a stream comes out with just an.

B

Issue so you're going to play on your like s, environment, jj,.

A

I think so I think that's well, I'm going to figure out how to get jx installed. First thing.

B

I don't think it'll work and the reason I say it's because I think james rollins is going to produce a compatibility matrix. He doesn't believe ibm cloud's been efficiently tested at the moment. uh Here we go.

B

So your results may vary more than mine, very.

B

273 megabytes jj.

B

Now it's a two gigabyte file, and that is the actual presentation. This will indeed not be done by the next hour.

B

Which fills them with great pain and.

B

B

uh Quite a while first.

C

Time on minikv.

C

A

Okay, let me uh share my screen here.

B

Okay, go ahead.

A

um Hang on where'd zoom go.

A

Get your screen.

A

All right so this can you get pogs oops odds, so here's a kubernetes cluster we're running here, oops, um don't know. Even I don't even remember what those things are, but we need to install jx first here.

B

Yep, you need to download the binder. It gives you a few helpful bash commands to do it's like a curl and a move, and that's it. I think.

B

But yeah bear in mind there's no steps for cloud on drinking's x3. As far as I know not in this part of the docks.

A

Okay, well, let's, uh let's go on an adventure, sir okay.

A

B

And are you sshd into your linux box.

A

Yeah, you can hop in if you want to.

B

Yeah, I'm gonna sort of watch and.

A

Observe jx there we go, we've got jx installed, all right move.

C

A

Over here and this over here, because it looks like our faces- are in the way.

B

Yeah and then, if you go to that jenkins x guide, um I don't know how to infrastructure a bit, but you might want to skip it and go straight to this operator and see if it actually gets pulled quicker than it did. For me,.

A

Oh hold on, um can you send me your repo real quick, so I can just coin it down.

B

Yeah, it's um it's github.com, a robert slash, adam cool.

A

A

Oh, we need to go in and change that, don't we.

B

I think what you would eventually do in a real system. Is you get the inverse ip uh of yourself? It would use that instead of my mini q by p, yeah.

C

A

A

A

I'm just playing cluster data.

C

A

A

Come on computer do your job. There we go and here's the subdomain.

A

A

There we go all right, so jx admin, opera, nature.

C

B

um But james itself is executable right.

C

B

uh Let me just screenshot that and give it to james.

A

Yeah, like that's, that's new.

A

Oh, is it because I did the http not ssh and has to push stuff back on ssh.

B

B

What's up sorry jj.

A

um I'm I'm scratching straws hang.

B

On I shouldn't do any off stuff yet because it's not yet prompted you for a name and a token.

B

Can you just do a happening at some jojo.

B

Because I think um if admin is a plugin or if that's the command to the jx by the way.

A

Well, if you do jx, it doesn't come up here. This is.

A

C

A

And so let's get over in the cluster and I'm supposed to run it inside of this and I get a permission denied. But it doesn't tell me why so.

B

Many jx on its own, it doesn't say admin is a command. Does it.

C

B

C

A

Is that jx hyphen operator yeah? This is like a plug-in um if I go out of the directory and.

C

A

J j x admin.

A

No, it's just not letting me do it all right.

B

Who are you jj? Who am I, who are you.

A

Are you a normal user.

B

And you can touch files because you always use this one. Don't you.

C

B

Need a git clone so yeah you can touch things! How strange what the permission refers to then.

A

Yeah now it doesn't work at all.

C

B

C

A

B

Step for installing the operator.

A

So I think we did, but that doesn't make any sense, because I just pulled down the jenkins cli.

B

Yep, so you went and got a binary for three dot, something.

A

You just did this.

B

Yeah and you can do normal jx so now you might be able to do jx admin.

A

So that works so.

B

If I do jx admin on my mac, let me see if it prompted for anything.

A

Permission tonight, sir circle log or something.

B

There's no problem, somebody get exactly right zone. It's not like saying you know. What's your password, you must be a root user.

A

So if I go back to.

A

Especially peter robert github, he roberts and pool sudo jx.

A

Admin operator.

A

Where did my password key password go.

B

Copy, oh, it's not a roots path. Is it's on your local path? There's t-box.

A

Oh crap, um okay, so let's try.

A

This is just like mean.

B

Yeah we have to bear in mind no one tested it before an ibm cloud, so you are a true trailblazer. I think here jj.

A

B

Oh I've got image paw back off. Actually, let me just pull back off what.

B

Oh, oh man, I got no space, that's on device.

B

Oh my it's on my mini cube coaster.

B

C

A

A

I think we failed again. Man.

A

I think there's, I think, that's really the only answer we have here like this. Just ain't working.

A

Oh all right, so what do you want to do? What do you want to do.

B

Well, um we can't use mini cubes; it takes forever I'll master it in.

C

B

But I do want to use minikube because I don't want to use google cloud yet or another cloud and the instructions do say: infrastructure mini cube.

B

So I think I just need a bigger mini cube cluster with the definite disk space I cheated because it was taking a while to create and I'll give it four gig disk space. You know we've done 50 gig. I can give only 50 gigabytes of disk space. I can do the add, an operator command to install the git operator.

B

C

B

Like in a week or a few days when it's actually pulled, hopefully, then we continue to stream.

A

B

A

Just just throwing this out here, um I could spin up a bare metal machine on the ibm cloud, install virtualbox on there and then install mini cube on that machine and basically just turn into one massive mini cube cluster.

B

But how would that be better than what I'm going to do.

A

It would be in the ibm cloud, so it's not on your home network and so I'll be able to pull down. And if I do it from the.

B

A

You know I mean that that's something I have as resources. I can easily use cloud resources for this and.

B

You can then get webhooks working.

A

Well, let's, let's not, let's not bite off more than we can chew, let's, let's actually.

B

Get at this point, I think if you do that, I think then you'll be really good. You know the absolute king of drinkers x.

A

Mini q, I've done um bare metal, so I'm taking a note, because I'm not going to do this right now. This is going to take me a couple hours to get together for metal mini, um ibm cloud. So what we could do um if you want to target next week, are you free next week about this time? I'm.

B

A

Okay, how about we target next week um for another stream uh that gives us seven days to get everything's up and running again, um and then we will try it again. I mean that's, that's what we.

B

Gotta do right: I'm gonna basically get a bigger mini keyboard. You're, going to get a good ibm card, mini cube cluster, we're going to try it with the images pre-pulled. Hopefully,.

C

B

Of our machines and really see if drinking is x3 can be made to work and do some kills. I've checked on maybe.

A

Yeah, that sounds that sounds about right.

B

At least you've learned our lesson that mini cube is really slow. Pulling things and uh question denied is what you've learned jj.

A

Yeah, that's that's just a weird one.

B

Well, how will that be resolved for next week's stream, for you.

A

Well, I'm not going to run it from my laptop or I'm not.

B

Going to oh yeah, yeah.

A

I'm going to run on ibm cloud um and I'll I'll make some time to actually go through myself too. um I say that we give this one more, try, try and then then we can start pulling in some jenkins x. People.

B

A

um I think it's reasonable enough to say that we should, because you know this is uh this- is not ideal.

B

Yeah, it's it's difficult and it's really big and biggest unlike unsupported environments at the moment, but it can't be that rare for the people on mini cube to be testing things out as well. It's just you know it needs like a little disclaimer say morning. It's gotta take forever to pull so you know, go and put the kettle on and come back in a few hours.

A

Pretty much pretty much.

B

All right, jj, so yeah we've learned that lesson.

A

Yep, all right, um and uh just just uh for completionist's sake. I will be publishing this to the cd foundation twitch channel or it's not a youtube channel here in a little bit uh so we'll at least have this for historical sake of our wonderful journey. Through this uh this um issues- I guess I don't know, I don't describe it all right all right. You want to say bye.

B

Yeah thanks everyone for tuning in and uh if you are going to cdcon next week or in two weeks it's on the seventh. Please do go to my talk. You're learning about the titan community learn a few things and I hope to see you all in the live q. A that's it for me.

A

Cool all right, well, uh yep signing off, say I guess, saying goodbye. Bye, bye,.

B