Jenkins Configuration as Code Project, 17 Jun 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Jenkins Configuration-as-Code office hours, Jun 17, 2020

Description

Regular Jenkins Configuration-as-Code office hours: project updates, ongoing development and future plans. At this meeting we discussed the new credentials from file feature, new Bill of Materials, and the Plugin Manager Tool 1.1.0 release.

Agenda and meeting notes: https://docs.google.com/document/d/1Hm07Q1egWL6VVAqNgu27bcMnqNZhYJmXKRvknVw4Y84/edit#heading=h.9yop7ufqevo5

A

Hello, welcome to the Jenkins configurational code project meeting today is june 17th and we have a team again. Joseph me, on the call so we'll just discuss news related to configuration, is cotton jenkins and then focus on ongoing development and other topics. I also wanted to discuss. Jake asked map status today just to check whether we have four other action items on the roadmap and by the vini table, statuses and guess so: that's it okay. So regarding news, one is a kind of ongoing thing we have did on the configuration which needs.

A

A

Yeah so one thing that I finished damaging configuration is code, well it kind of works, and now it has recent plugins and it supports the read-only mode which can be used for testing of this configuration, though I still need to immigrate. The Domino Jake ask because now the demo is largely configured by groovy a script. But if anyone wants to test on the permissions, it should be basically the same and I think that we can also.

A

Something else: are they Mia other demos which have been already a bit too configuration is code, I mean to read on the configuration.

A

Yeah, okay, so other new said that the Bill of Materials is finally up to date. So it means that Homer we uses Jenkins plug-in one. Now that was recent version of Jake can buy the T in version 10 right, so yeah I won't lose a lot plugins. We finally similar to that. So thanks to everyone as a specialty team clicking quit over the line. So now everyone be their plugins, mistress and Jake asked without a lot of hassle.

A

Okay, any other news, a missing.

A

Well, maybe satellite a minor and just the at least plug-in any installation manager, basically Jake asked stories and we atleast. We released a few patches so, firstly an hour. The recitation of the unloaded plugins, which can be used for, can be utilized, for example, speed up doctor bills or just common instances. Then we have option to skip downloads if something fails, but implementation of retry and I also fix. The issue is transient dependency resolution because actually, before this patch the tool was installing plugins.

A

We should run dessert on the instance and we hit a buggy CI themes being installed through a trans in dependency implosion. So now it should be fixed though it's just a partial fix. The behavior of dependency resolution is still not optional. There are reported bugs, for example, for optional dependencies, they're not resolved properly in terms of version control and also collisions between transcend dependencies in lower levels. It won't be working available, still it's a kind of improvement being compared to the previous state yeah. As always, contributions are welcome.

A

So I'm going development and those of you want to talk about secrets, resolver right, yeah,.

B

The only thing that concerns me in the pollen fest again is introducing something that you might remove, or it might be confusing to users that exist. It might be hidden somewhere, yeah.

B

I can I put a lot of discussions with myself in to actually for anyone reviewing it to hopefully assist with their thoughts, but I.

B

The thing you could do is you could go down to like just have it one thing so there's only one key which would I guess would be pay sixty four and then it will figure out if it's a file. If it's a file, it will do the right thing or if it's a a string, it will try and do that. But the problem is that you would get weird behaviors.

B

That say the file doesn't exist and then it goes into the other logic and then but then you have to check if two paths- and it gets quite messy.

A

Yeah, maybe you should just be the perfect something like base64 file and that's.

B

One of the adoptions: this is really a thing where you can combine them actually and because you might have a file you want to read in and then again maybe we should just support two and then don't support nested. But then you want to support missed it because you might want to have a viable. That's not obvious if PAH file path, if you don't want to show where's it.

A

On my experience with variable hand, Lincoln Jenkins, especially with infringing plugins, is but let's avoid nested variables, but yeah if there is no real use case for that, I would rather prefer to keep it simple. But if you see a use case for that, thank you there.

B

Could be useful where you would have a secret that you want to just pay 64 like a string, so that would be a secret that you would didn't have to worry variable you have to resolve, so you'd need two nested thing. Of course we could try and prevent the nested thing that you could like to write some logic that would prevent the nesting of these two together, like the page 64 in the file, 64 yeah, so yeah or.

A

Maybe we should think about a bit more intellectual maka engine for resolution, because I hit similarly issue. So there is a pluralist which basically is where you literally wait to dirty about encrypted passwords, the one which I still cannot finish, though decrypting credentials and there so yeah. This is the current implementation. So basically I have strings like that, which is also kind of fierce Makran. So maybe we could standardize mccracken them.

B

It's really, you could write a with the current one. You can write another replacer that researches for those things with the current thing that I have in my pull request.

B

You can create your own and you can create doing replaces and it could look for those things mm-hm, and it is a bit it's another common library, but it has a lot of features for like for like doing string replacements and having multiples and stuff like that, so I actually I needed to create a secondary replacer for having the block when people didn't have a secret that was filled so yeah. It wasn't that hard to and to get around that.

A

Okay, so anyway, these things are slightly deleted. The.

B

Dish slightly red yeah, yes,.

A

So our dissolution logic becomes more and more complex. That's really.

C

A

Some point we should think about either a formal marketing engine, with extension, points etc. So, similarly, to talk in a macro plugin, oh.

A

Yeah actually so.

B

You want exchange this one shop here that that could make sense well.

A

It would help to break down logic a bit because ya already hit the number fishes in tests when I was in lemon. Looking this proof request I'm, not sure they even submitted the pull request, but yeah was it mostly stuck because of edge cases. So talking much a plug in my basically prevents logic like that and foo is an extension point, so you can migrate your own ones.

B

Yeah we can. We are almost there to have extension points, but then at some point, why not just use the choking thing the token plug and choke my conclusion to to do that work force if it suppose the same stuff well.

A

In principle, yes, in practice, this plug-in I had no support even for pipeline for a while. So you.

B

A

See the extension points right now, so I set this macro name etc and then example they will need for abstract project. So it's what you can be right for errands, and now we also have even late for pipeline.

B

Okay, it doesn't work for our use case well,.

A

Yeah, technically we could.

A

Plug in context.

A

B

The thing is that we're almost there actually, on the other end and in the my pull request, I I think it would take like one or two lines to add the extension point to like resolve those ticks and and then because, as I said, you can add any replacers and you can then just search for those replaces and then add them in yeah.

A

Plus one for new extension point.

B

Be nicer, it also would enable other stuff that we have had people asking for like, instead of the current way of like creating secret solace, the way we do now they'd, it would be nicer with more syntax like if you, if you could like, divert turn that part instead yeah.

C

B

I would much rather have also path and didn't like wouldn't vote to : and then something string stuff. That would be a lot nicer. Yes,.

A

Or something like that.

B

So it's declarative, like it's happening.

B

Also for so it's easy to anyone who is a configuration administrator to say ah this is current. Football I should probably go look at fall instead of length where do I look if you're using kubernetes and bold at the same time, and some of them are coming from. Hopefully,.

A

Yes, because right now, it's so easy to fall into whatever force resolution. Yes,.

B

A

Current logic and really start enforcing something like that. That's.

C

Gonna last, you can't have multiple strategies, though so like locally, you can load it from the file system, whereas in your actual production system, you can load it from a system that.

B

Is nice yeah? That is true, so I'm not in favor of removing old stuff that works, because then we would have people that have workflows that gets destroyed.

A

So basically, generic dissolution.

B

Been using that for our use case as well, we.

C

Use it as well, we.

B

Have a in our case we have a Duggar compose that just have the environment variables loaded in and then yeah off. You go.

A

So I think that this approach is don't conflict with each other.

A

Or maybe introduce another syntax for one off because unlikely you have three sources. Well, theoretically, if you deploy the same instance, let's say in kubernetes and docket and locally for testing and maybe but.

A

Anyway, I think that we need to review this pool request mmm yeah this one well I, think that it's kind of you told again, but yet how much junk do.

C

A

Do you want to just keep a disease and we can go from the top of that I.

B

Don't want to rather than extend this PR, because for what it does right now is again, it has yeah it yeah I, don't necessarily like the way it's doing it.

B

Good and again want to try this little less, not so much confusion like for the users that are using it I would be using it.

A

Thank you so, basically another iteration before we merge with it yeah.

B

A

But yeah thanks for working on that, it's a useful feature: yep, okay system rate permission. So do we have anything stitched for reviews, etc.

C

Let me see me related one is the lock recorder in core for configurations code.

C

That's correct: it's currently the only thing that we use to change your life or.

A

Like certain to support it.

A

Yeah, the only problem with it full, lock record we system did that omission. Are you able to configure you recorder so not because what's approaches kind of make sense.

C

What's the straight, can you know system rate can configure orders, you can just view previously configured ones. Okay,.

A

So I was just wondering how much tells because, for example, if you want to ignore something, usually at new walk recorder and then principally see low key for the only permission, because you don't add new functionality, you just capture existing notes. At the same time, no idea yeah.

C

I mean one of ours is that we use it. We lose our locker for the configuration as soon as a reboot like its regretted, whenever patches can apply automatic. Think of any reason.

A

Well, anyway, we can figure it out later, but you know we only is a safe choice, maybe I'm not great for user experience, but at least definitely good from what technician standpoint.

A

Okay, and did you get enough issues for plugins reported.

A

Not doing it problem.

C

Is probably plenty more I could have support, and it seems that issues racin.

A

Yeah I started running my demos to verify dark theme and tables to leave some English, but the end principle I want to use the same demo to describe for system admission, and maybe you use other demos to have more plugins example. We used to have this demo for club. This drink is distribution and Jake asked. Maybe he can spot check Oh plugins. We have embedded something like two hundred ones.

A

Some work, but just processing that and reporting issues way we hit them, would be different, helpful.

A

Okay, so yeah what you think needed.

A

Okay, anything call some system grid.

A

Yeah so for plugin installation management, yeah, just a quick update, I will be submitting more patches because I really want to get rid of custom, plugin installation manager, implementation and jenga's file runner and apparently I still he teaches one trying to adopt it. So I will be submitting a few patches, but I can confirm that llamo configuration, etc. Work pretty well. I also did some experiments which depend about for llamo configurations using the tool created by Olivier for infrastructure and actually it works.

A

So maybe it will create such a bit flow because I'm not really keen to use pom.xml as a source for common users, words.

A

It works pretty well for customer picture, but customer packages takes hours to build, and this plugin installation managers now support for caches. We can actually speed up the wheels a lot so I would rather prefer to try implementing automated dependency management for plug-in installation manager, not for custom or packages.

A

So yet missing, hopefully we will get over the line.

A

So dependable telluric think I think, we'll be just an embedded into plug-in installation manager. So there will be no new tool for that. Yeah.

A

You know sure, does anybody else use plug-in installation managers in Pradesh? Now we.

B

Try it several times so yeah we tried and didn't work. I think you fix one of the box, though the unwanted Transplant, it yeah, unwanted, plugins, I'm,.

C

Sure it would work for us and I think we doing anything just to see whether it's faster and if it was in the dock members. We really just use it. Yeah.

B

C

The default in the docker image and the main reason that would look just a movie: it would be automatic updates.

C

A

The result of the command, which shows update I, spend some time to get it working and, for example, the recent perish for damaging his configures code was basically produced out by the tool. So this one big machine.

C

Is a machine persistable or is it human well.

A

It's it dumps text file and then simply regular expression and you get so the.

B

A

Step is to put this simple table of X rotation right hand, side for the tool, so I created an option to it in Europe, it's file in available updates, so basically the plug-in manager will be able to Venice on its own without all this magic in the Yamal plugin 60.

A

Well, technically, it might be difficult if we plug in the management, llamo and Jake asked Emily in the same file but yeah as long as they separate. It's, not a problem even.

C

With merchants they currently like.

A

Yeah one thing I noticed that it still has some wealth. It still has glitches via strands independence management, so it will get patches before it becomes fully reliable. At least come on. Butcher completes its maybe 30 minutes to implemented yeah.

C

I think I think we just specify everything anyway, just so that we don't get out of type plugins, yeah nice. We didn't have to.

A

Mm anyway area plan to spend some time because I needed for a new edition of customer packager I want to have to some limitations of plug-in management, a mankini. So this tool is a way to go. For me.

A

Okay, any comments about this story, other things.

B

The only thing would be optional to condon sees those would would be probably another blocker for abducting, I would say, yeah.

A

B

No dependencies.

A

Here right here, yeah I confirm that I want sulphate yeah the problem that needs complete redesign of how dependency resolution works. So that's why I started from my Foreman splash I just changed the top-level dependencies.

A

Even there I hit some issues so, for example, if you take a look at this boot request, you can see that, for example, if you use maven for Sep, then whatever you do find on the top.

A

This is what you get and if you use them for Siri, if you have trends in dependence of high version, then you get never and I try to implement such logic in flagging solving this tool and actually I just got an error in existing tests after that, because the logic of this tool is quite different, it still tries to pull the recent fashion from transient dependencies and I think we should stop doing that. Instead of that, just failed a build.

A

Yeah, that's just the beginning, because basically we need to redefine completely how this logic works because yeah there were so many pitfalls and the current resolution.

A

So if somebody still remembers graph theory from the university's, probably writing to apply it. Yeah I think I will just take code from my reinforcer or whatever hand embedded in the plug-in, because I think the.

A

Resolution, how may be junk is called code base, but same.

A

But yeah thanks for the feedback, so I definitely want to spend some time on that.

A

So any other ongoing development.

A

Give, let's just take a look at the roadmap we beat so I wanted to check with you whether we have all stories are there, so there is definitely no story for flag in relation manager. Probably I will call it plugin installation manager to the zero, taking the breaking changes in how dependencies are resolves and yeah right. Whatever manifesto for this version, I put it on the roadmap, but the rest. So what do we have now? A system recognition? Then pluggable configuration sources, but they address that's all we have specifically for Jake asked yeah.

A

Do you want to add something else.

A

Okay, does anybody have something big in mind that you want to implement in the next six months.

A

Probably so yeah so just to spend some time at the next meeting, but yeah we'll integrate plug-in installation manager and customer package of stories in the roadmap and yep basically same for any other plug-in not for Jake asked. So my personal plan is to have roadmap officially approved at the next governance meeting, so not today, but in two weeks. So, if further, a big story is your work in whatever.

A

Degradation through the vault or whatever we can put it. There was my team's. We have special, specifically user-facing items. I would be hopeful for the project.

A

Anything else for today.

A

I guess thanks everyone for your time. Thanks.

C

Thanks everyone here, fighting.

A

It okay bye, see you in two weeks.