Jenkins Google Summer of Code Office Hours, 12 Jul 2018

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Jenkins Online Meetup: Google Summer of Code project demos

Description

Jenkins Google Summer of Code students will present the current statuses of the projects and show demos. We will have 3 projects presented: Code Coverage API Plugin, Remoting over Kafka, and Simple Pull-Request Job Plugin.

More info about projects: https://jenkins.io/projects/gsoc/

A

Hi everybody welcome to the second Google Jenkins Summer of Code presentation sessions. Today we conducted this session as Jenkins online Meetup, so we'll have some introduction and then students will do their presentations. Let me share my screen.

A

Okay, I reduce my screen.

B

A

So we have all the JSOC students on the cold plus some mentors, plus some participants. If you want to join the cooler and ask questions, we also have Jenkins get a shot, there is JSOC sit there and you can find a participant link where and actually it's a main channel for skin questions. But if you also want to talk, ask questions without using beater, we have Jenkins chat in IRC, so if you ask questions to their due process to them and ask them to participants so yeah, let's start from the presentation.

A

So as I said, this is the second session the last the previous one was four weeks ago and all our students have already presented their projects, but today we do these presentations from scratch. So if you have not dissipated and in the previous Meetup please stay, you will see you all introductions, etc. As I said, there are two great channels, so is feel free to join any of these channels. Okay, so just provide some introduction.

A

What is a google Summer of Code, so google Summer of Code is the biggest open source initiatives and event for students, so they're thousands of students participating in google Summer of Code. They join a different open source organizations and work with mentors from these organizations in order to develop some open source code, and yet this year Jenkins participates in a google Summer of Code. This is our second year we have participated. Two years ago we had five projects and some projects were successful.

A

So it was a nice experience for the organization and we want to participate again and again, and this year we joined the project and we have three students, so she usually is working on code coverage, API plug-in, which one I use working on the remote in over Kafka and Abhishek gautam is working on simple political, Esther job plug-in. If you want to find more information about these projects, you can go to the project page Jenkins are your projects jae seok, and you can find all information there. So you can go to any project.

A

For example, it's promoting our message. Bus and here you can find all information about the project are links to the presentations to their previous blog posts, and if you want to find more, you can also join a project. Specific knitters, channel and project need hub repositories. So what do we have now? Oh, this okra is a multi month project. It has started in February now it's July, but we also have four weeks of coding ahead.

A

So maybe, after this months of coding, we'll have a second iteration, but even now all the projects have reached the mobile stage that you can find that this project imaging is experimental of these centers. So we decided that it's a good opportunity to showcase that these projects and probably to get something bit from the community.

A

So let's continue these presentations, let's start from ginger, and then we will proceed with other presentations so see you. Are you ready? Yeah I'm ready? Okay. So if you share your screen, I'll make you a presenter yeah.

C

Can you see my screen.

A

Just a second, so we have presented you to everyone. So now all participants should be able to see it.

C

Yeah, okay, so I hope at least be this year's to soccer. She stopped checking the project and the walk own code: College API, probably my Mentos are Stephen Shappell, chairs and Oracle. To do me much help in this project and the sex team. So about me my name is the surgeon and I am a third year student in computer science and technology at a renowned University from China I like programming and annuity, especially reading some books about history and a philosophy.

C

So in phase one I had at all I had a friend so since prototype uh based on cobalt, Roppongi data model integrator as a Java code, ecology talk, echo jacoco Oh to detect support health before support heparin suppose in the slash core support. Also how modernized the report and uh like some unit tests so in phase two I had planned to do.

C

The dosing api's, which can be used by others like integrator capital per game, is called Khao Lak, probably like a provider Java API and the REST API for getting current information and implementing abstract layer for utterly perform at HSN.

C

Also supporting commenter's for no Java language. I only support a child and reduce poverty. Talk in phase one but supporting any reports using a builder I, encourage you in Coweta detailed page and expect orient a configuration page to make it more user friendly. So fast, I have thumbed integrate other proteins.

C

So for now, I integrator commercial program is called colors. If you have probably and I. Also yeah I also have a new API option in cabbage lapaki like her just clean shot. So no we can enable code coverage a PR progress in capacitor, probably when we click test this checkbox and if we all generator a new format reporter this you with more sciency UI chart also I have provide some more rest api. We can't get a college date, get channel date and get a card date of the last computer.

C

Get stranded of latitude, so I will demo it yeah. So, as you can say, we have, how did you lose RPG interjections?

C

You can't get a result page by this. You can get coverage out your information parties in person for magnetized yeah. This we are getting more informations. Also, you can get a transit Kendra from war.

C

C

Right, XML format.

C

As you can say, you can also get Jenny bit and also the last trend and raster. It.

C

Besides the REST API I have also supported more college cost like IBM, ecology, just informatica pot, and you can say more information, interests, pull request, it'll, be our channel either way generator LLVM, Oh, Cao Lu Jia report. Each way our show ll be a more collegial reporter by the most fancy you I like that yeah we can get a function and the college eight also I have other implements like I'd source code navigation in Cal in college, the third page.

C

So for now we can how we can view the source code with cao lu, chi' information for our colleges, our page and also instructor the configuration page to make it more user, friendly and user can now more easy to use all proteins, so the deaths of it awful face vamp ran that whole town totally acceptor exacta.

C

The supporting can manually post meeting a buddha in phase to be plan, I plan to mmm supporting more college toss like a Chico like a college GPA and as a college you toss also I will polishing the code base impacts and the writing. Few are permanent or documents and user documents and the final I will release into proteins. So this a speeds, the links for later you solid you can get more information from source link. Yeah thanks.

A

Thank you for the presentation, so I've got a question. Could you please show called coverage browsing and if possible, I mean you got Emma? Oh.

C

D

C

A

So what what question so? Is it possible to see code coverage statistics I mean? Is it possible to see code and to see code coverage starts void? Oh.

C

You mean showed soft code. Yes, yeah, you can see the source code of is a college information in this level. Mm-Hmm.

A

Oh that's cool, so it was one of the questions from the previous demos and yeah she knew has implemented. It might be in two days after the Meetup. Oh yeah, thanks for doing that. So let's proceed to other questions, and so Jesus was asking about an usual format of epi for trends so Jason. Maybe you would like to ask a question directly in the chat Oh.

A

Receives on the call today, yeah.

A

About 20 pas, oh.

E

Right yeah so well, normally in Jenkins you have different model objects and then they have an API, get the API method and then the API object serves all of the the export API yeah.

E

They just saw a strange URL pattern here that they never saw Nelson Jenkins. So it was curious about that. Oh.

C

Yeah, so you thinking, we can't get object by URL, so API actually is not a normal EHR. It is the object and the way out with go to the code, for you. Yeah wait a minute hmm so, as you can see,.

C

Api carry is not mutant, the API object. Eta. Our agenda are just four colors record and in this class we have API with help. So you can village, we can get a restful calculator by micellar API and also understand data. We are API information right, don't matter, yeah.

E

Okay, yeah I suggest.

C

E

I suggest yet to make this consistent with everything else in Jenkins. I suggest refactoring this so that the first class, so that coverage result has an API, get API method, and then it also a coverage trend, tree, get trend, method and then coverage trend tree has a API get API method that would that would be consistent with usual usage and Jenkins, so that each model.

F

E

A as a slash, API, slash, XML, or something like that.

C

E

It will look better in the UI. Also there's well, there's reasons: two reasons to do that with the automatic API link that you good at the bottom of pages and that sort of thing yeah.

C

All right, you know, I, take it voyage. Thank you.

A

Jesse you had another question right.

A

About levels of information.

E

Right so yeah, it's been a long time since I looked at it, but I but I sort of remember the maybe it was jacoco could track coverage of a if-then statement on a single line of source code and cobertura could not do that or maybe it was Emma or some other sorry clover or something else didn't track. It so he's wondering if the API has a way of handling tools that have different levels of details. So some tools, may you know, keep coverage per line. Number some tools may keep coverage with more level of detail.

E

Anything like that. You.

C

May add, as much code like a food coverage offer class, is it lower than some number so like that? No.

E

No, it's yeah, it's more that if I remember some I'm gonna type, an example here that some some tools are able to have finer levels of detail. Oh.

A

And so maybe you could show how the code is organized in terms of multi-language support, because it seems to be closing. Oh.

C

Yeah so for multi languages, yes,.

E

It's multi-language support, yeah.

C

So for now, I have add a multi-language support, as you can see, Italy also put LLVM and Java, so we have a VM functions and Java class and Java matters in the same aggregated report, but it is still have a little back. I will fixed in it yeah I.

E

Was how much wrong people yeah that wasn't actually a question? Oh I'm, trying to get working, get her and I'm not having any success with dinner first today for some reason, so.

G

I guess it's your question about like if one of them reports things like branches and the other ones, don't so I think you look at dinner, chat.

E

Sorry, fine, we got it, it took me. It's.

C

A

E

Tools will be able to say that do something else has been covered by your tests, but do something has not, for example, because rare condition was never true during your test. Good.

C

E

Be a feature of jacoco or something I. Don't remember: I.

A

Almost remember.

E

A

Maybe you would like, maybe it makes sense to talk about how plug-in developers benefit and which features they get him if they integrate with the plug-in, because yep since JC references these conditions, it seems to be one of the Tata Croatia generalization like we did for thresholds and added multiple options to to the plug-in. So maybe it makes sense to talk a bit about such features available.

C

You can specify different point like that. If we integrate a much power coverage at all, I used to be integrated, multiple languages college talk, we can start suffer it.

A

Yes, something like that. Actually, what I wanted to say that, since code coverage cpi-e is an intention to offer reusable features and reusable functionality, it means that every plugin integrating already gets some edit video and the idea that this could cover cheap. You will be not only period but some edit functionality provider. So, for example, once you integrate computer plug-in with a coder API, you get 20 PA, you get these kind thresholds, I mean global ones, and you can also add things like, for example, a partial bill publishing pipeline once it's ready.

A

So what what I wanted to say from my point of view that this plug-in allows offering such features and make them reusable and, for example,.

A

For example, shinu has implemented a new plugin for Olivia, it's not a new plugin so far, but yeah previously, we didn't have LLVM support in Jenkins at all any user who was using vm code coverage. They had to convert the data to cobalt or whatever other format as a separate tool and yeah. Now it's possible to just write the implementation of few extension points and get it working. Oh.

C

Yeah, so for me how IBM support so can't separate it from our power property and other.

C

mmm As a new property like that, so user can improve, so you de can just using the using the state just add our protein dependence and just implement or out of hat and to use our inefficient exact. Oh yeah,.

A

Sorry, if I confused your beat, so mmm thanks for the presentation, I see no other questions so far, so maybe Jeff and Steve and spoon would like to say something about the project.

F

Yeah, so I guess I could go first so on. This is something that the the Jenkins community, and particularly people, that work with code coverage plugins in general have been looking forward to just kind of finding a way of having a common way of generating reports and as a user of Jenkins, we spend a lot of time looking at code coverage, and we have lots of different different types of things that we build: javascript native native mobile, etc. With different report types. So we're pretty excited to see to use the results of this.

G

Yeah I agree also, it's it's coming along. You know perfectly and.

G

I'm kind of excited to see the end results as well.

A

It's not the end results. We still have one month ahead, so.

G

Yeah we're almost Yeah.

A

Right, so if anybody wants to provide feedback, it's a good time, I.

H

Think he's doing, engage yeah relating in resets.

A

Me too, so yeah thanks a lot for this project. Now, maybe last question from Jesse before we move on what is the storage format when using could a new API are still using very binary formats so or new format?.

C

Or either using using a steam profile, XML format of cobalt really pod, remove some yeah.

E

I say you're here, taking the covert, for example, the jacoco I think has some minor defines so you're parsing that throwing away that file and then saving an XML file using the data you define right.

C

Yeah yeah, just a passing other formatted report into the steam profile. Sympathizer coverage for our report is.

E

That person done on agent or on the master, oh.

C

I think it is down if the if it is dependent or the mmm well. The report is I think.

E

Right, yeah I'm, seeing if, if you ran a bill on an agent in the ribbon, say jacoco or outcome on the age of, do you have the agent parse it and send back the and send back your generic object structure to the master or does the agents and the jacoco binary files, the master and then the master parses? Oh.

C

Yeah it'll be all in the file. Okay I know so it's master side, person, okay,.

E

A

Would be possible to implement the agents on site parts in Quetta, but yeah both approaches have their own advantages and disadvantages. Actually it's not been difficult to implement another implementation. If we need.

I

A

Okay, so thanks for the presentation, let's proceed with the next one, which one will present remote in Kovach off project Bhutan. Are you ready.

J

Yes, I'm ready. Let me see my screen.

J

Okay can see my screen. Yes,.

J

Okay, so you know everyone. This is a second finished evaluation for who or some up code. My name is muffin and my project is Jenkins remote thing over message, mas and Q. So, firstly, sum which introduction so I'm a computer science student from Singapore and working together with me in this project. I have eleven sukoon as a D supplement and also I have the support from Jeff and David. They are developer from promoting project. So what's this project about, so we have the current version of ten pins remoting.

J

We use PCP for direct master and Asian communication, so they are accepting the problem with this jnlp protocols forces. If the connection origin fails, we have the beautiful and we have to start again. They are also the issue with the traffic pattern station and Monte Asian communication, and this impactor, then instability and scalability. So the goal of this project is, we want to to make use of the message. Mass technology and we decide to use Casca develop under develop as a plug-in to add a photo, luring communication layer injecting this.

J

So this is an overview DSi. What we have in the first phase, so the project consists of multiple components. We have no muscles tie with plug-in. We have the calf Nagano configuration where we can specify the host and port of the calf graphical and also we have a cupcake of the launcher which use the custom common chance for which create producer and consumer instant to do the communication from the ice inside view. So we have a custom engine.

J

We also use a new convention spot ever so we ban those removed in the remote danger from the in the Asian side. So now the communication we not using direct ECP from us directly CP between master and asian, but instead on the communication, is done over Kafka.

J

So the summary of perfectly we set up the local compost components that we we do a POC for the comments as for invitation. So in order to do this, we have to patch the remoting enter code to make things easy and extensible, and we decide to use Kafka as a final appeal intention for this project. So you can find more information about this. The first day through my blog post.

J

So, for the second phase, we want to improve the security and reliability of the current plugin. So we support the release. We decide plan to support the security for master and Ageing condition with authentication and authorization, as well as the secret exchange like we have something similar and in jnlp. Also we want to improve the exiting producer and consumer model to ensure reliability.

J

There are bus in first one and we continue using it in the second phase and we want to in this way we we plan to release an alpha version to receive the feedback from the communities, so this was updated, our updated vehicle for the second phase, so we support the Kafka with security, enable we can say kissed by enable etc. So from the master side, where we conflicted Kafka, we integrate with credential plugin to let users to enter the didn't, show the username and password to connect to cafe, and so there's another component in yeah.

J

So my mistake, so this would be inside so so this comcastic manager is in charge of ensuring of a change changing secret with asian. So, in order to do to do that from the Asian side, we have a current listener, which is run in a separate friend to listen to secret initial message from master so on. The communication now is done through execution over Kafka.

J

So there's also an improvement for the producer and consumer model in mutation, so we previously, we used dynamic partition assignment, but for this phase we decide to move to manual passion, additional assignment for Kafka, porcelain consumer. So when this implementation happened, the benefits we reduce a number of topics for each condition and also the consumable group need to be used.

J

So next for the next part of the presentation that we saw demo for the plugin.

J

So SP continue from the last way we can configure kafka things from functional configuration. If we install the panel here, we have an option to enable or disable the Assessor with good and sure so first I will remove it and they bow SSL option.

J

So we can create a new, a new age in here and choose which CAFTA option. So, if we click on this enables area, we need to provide a username and the security option.

J

So if we go here, we can see the trip to run the Asian from a Java. We have the secret permit wishes. He has using each map and go with them and if we copy paste this script to run the job, we need to enter the password to connect to to master a to capture a master.

J

It's Oh upon connection we have, the agent is connected to master, we can see the command transport and then on the four main things running from the Camino, and we have the Asian connected successfully.

J

So this is a new feature with security enabled we can also use a huge connect to Kafka, plus nova style, with relativity, so I will delete this.

J

Now and then I change the configuration to not using SSL.

J

Then, if we we're not using SSL.

J

We have to flock here so that this is a non secure, cluster, simple we copy and paste, and we have the master and Asian connection over Kafka.

J

Okay, so for the next part of the the moral view, I will also run. I will try to run the sample PI life over this Asian.

J

So basically, I have a pile, I hear a sample by layer. Here we take, we run run the pilot of this sample project, so I can try to run it and we see how.

J

So if I start running it, you can see the conventions for the command is sent from the locker.

J

Then see the console output is running in the Asian side, which a lot of from Mankato, and also we have I, want to integrate this, to which this you saw administrator to modern, monitor, Kafka, where we can see the graph and things the numbers either and I think this might be useful in the future.

J

Now so you can try, the use of that would mean dr. Campos I, put it in the compost for this project.

J

Yeah, so we have the PI life in it and is successful yeah and we can see on the common things from the you know. So this one end of my demo and I will continue with the presentation.

J

So you're sort of curious later if he needs the security support, we also fini the improvement of producer-consumer model. We release qu and perversion and under I spent Oh at the center, and so there's a minor feature. Is the support of common agenda proposed for Muffy? C is the continuous progression we will continue is we will continue it for Network face?

J

You know so, for the national plan is we want to mein obvious to release the one non-zero person, because it's a last day of who or some of court, so to do that we want to do a lot of packaging work and also the test automation for the plane and then, if time permits, we can try to investigate on the chunking capabilities for cappuccino, as well as the consumer, public or nao of chimps.

J

So these are useful links for my polish. You can see the GTOs it have people repository and show us my report about introduct introduction proposed and and fair release proposed.

J

So this is the end of my presentation and time for Q&A yeah. Thank you for listening.

A

So Jesse had some questions about the connection logic, so maybe we could start from them.

E

Yeah I just wanted to know a little bit more about the management of agents, so at least with with currently released launchers. There are sort of two different styles, so one style is the so-called channel Pete launchers, usually not actually using jnlp, where the agent is responsible for connecting the master, and it expects that the master already has a node defined with that name.

E

The agent passes some secret and if the ATM dies for whatever reason and the agent computer has to restart it by running some kind of service and then the other style that the other launchers use is that the master runs some command, which causes the Java Virtual Machine to be started remotely the SSH or something like that and those, and you would choose one or the other, depending on how you wanted image nodes. So that's especially important if you have elastic cloud system.

E

So if you're trying to run builds on the c2, for example, then you really want to know what's the way to get everything up and running from scratch on the new beats. You consider, though, is just wondering how that's managed or anything, the tough guy computer, the launcher. Oh.

J

Okay, so I see the question so actually the I see. The last question is the boundary condition. Actually, this we haven't been tested. Yeah actually I haven't been test testing it like the Asian guy in the middle of buildings or correct, but we have so.

J

Because we have the Asian is running and it has a separate thread. It has a separate thread for receiving the secret initial secret exchange. So it means if the master try to connect.

J

If the master try to connect it will I mean if we respond again, but yeah I haven't tested things like failing. Maybe we can try to do it in the translation. You.

A

Could show the current connection logic so we eat my answer. Some questions, Jason yeah.

E

So it's in your further Kafka connection, that's something that's running inside the agent JVM.

J

J

For the Asian ray.

J

Yeah so for the Asian is versus me, I create a new thread for the can see my screen yeah, so we create a new track to listen to for possibly so. Whenever the Asian received a secret, it will acknowledge and start, and we will start the engine is a custom engine, so the custom engine will create a common transport and it will connect to Kafka.

J

It will start a consumer and producer and kinetic Africa to listen for message. It is an Serene's of machine I.

E

J

E

I can tell it from the perspective of a Jenkins administrator. It works exactly like the NLP yeah. You have to start something. You start some Java process on the computer. You give the Jenkins URL and some identification that has to correspond to existing node definition on the Jenkins master and then at some point soon. After that the connection is made and it becomes an ages. And if that JDM stops for whatever reason, then you have to start it again from the.

A

It's a bit different, so actually both agent and master, they connect to Kafka. But if you talk about Jenkins the remote connection, it's been initiated by a master, so it works similarly to SSH slaves begin so master initiates the connection, but here their assumption and that was mastered. An agent are connected to Kafka, so master sends a connection request to agent. Then agent verifies that everything is fine, sensor response and then master to be the advice. That secrets are fine, etc and then it establishes connection.

A

But yet they think that master still has a monitoring logic, so pink thread and all other monitors, so master is able to really initiate the connection and once master initiates the connection, as would one set that connection pool should be reinitialized.

A

So I think that the implementation is different from jnlp in terms of implementation and it should be a more reliable.

J

One poised because we use Kafka so on the message a star is a so it means the the features of recovering after Phil I haven't tested that yet, but then we have a mass between a so we can reconsider the message it will raise data. As you know, we will try to see in the first phase if you.

F

J

Tcp the things that are lost, but now we have a video storage so.

E

J

A

J

A

Yeah, if you use Kafka in standard implementation, I mean without a storage persistence. Then, of course, if Kafka days, the messages are getting closed. But for the rest, the connection works. Fine. So I spent some time on testing that and, for example, if you bring down Kafka and restarted mustard connects. If you bring down the agent and the restart in some cases it can even continue working natively if there was no monitoring interruptions.

A

So it means that if network breaks between agent and Kafka, then connection can be restored and if you make a Kafka fault, tolerant, for example, in using message consistency using high availability of clusters, then you can say that communication layer results, fault tolerant.

A

So we need to experiment with it. But from architectural standpoint you should be possible even now, right.

E

Yeah, you can experiment with things like using low level. Linux Network commands to simulate having you have to simulate a network, complete disconnection or to simulate Network hangs or you can even do simulations of packets being sent in one direction, but not the other, and that's so.

A

You have some test automation, a plant for the next phase and yeah. Of course, non-success pass tests for networking disconnects will be in focus because it's what I it's difficult to heart, it constantly it's difficult to test it reliably. When you have no test automation.

E

It's very it's there any and you integrate this into any cloud provider plugins, because it's basically anything anything that defines an elastic cloud and Jenkins has to know something about the launcher in order to make a connection to a newly created computer. So it would need to be explicitly integrated with important cloud plugins. In order to be useful, you.

J

Know so we have a ticket I, think we have a ticket fall or integrate with the cloud di Poppi, but we haven't. We haven't, started cooking on that, yet so not sure if it can be done interface, so we have this ticket for.

J

The plow API into invitation.

E

So it wouldn't be a single I mean would be a plugin. Integrating promoting Kafka with clouds would be that for any cloud plug-in that we have in Jenkins, we would need to add a new option to use a Kafka based agent rather than the NLP, a staging. So.

E

We would just be patches two patches to existing.

E

A

So this I think could be done on multiple levels and and yes, if plug-in, for example, docker plug-in if they support custom computer launchers, it can be probably done even now. The only problem is to pass secrets to the agent side, but without identification. I bet that we can make it work in now, because you.

E

Know, I, don't think it's possible because what Jenkins or does provide an interface that allows a cloud again. You use a launcher provided by a different plugin it doesn't know about, but that only works for master to agent, launch methods like SSH, yeah and.

A

E

Turret connector, but that assumes that the master is you mean the work to create the machine and set up everything, including starting the JVM, initiating the connections and everything like it. Doesn't that doesn't really work or ya know p-type launchers, where the agent is connecting back to the master, which is what this is not.

A

Exactly because, as I said before, my state initiates the connection so master start on the connections chain, and it means that the only prerequisite is that by the time the master starts connection chain. The agent should be connected to Kafka right.

E

Well, yeah master, maybe sending some messages to Costco. That's fine, but from the perspective of Jenkins, is still the same that master, that the master has to assume that the here is already been configured and it has this JVM running and the JVM is and all of those preconditions are there right. So when.

A

E

Ssh launcher where the master really does all the work to take a generic, say: Linux server and yep get everything you did for remoting, okay,.

A

Yeah, maybe we could take the top line, but yeah I'm pretty confident that it's possible it yeah, even now, which one has created a packaging for agent in Dockers, and when you start the package they agent connects to Kafka. So it means that if we take docker plug-in miss Kafka launcher, it will first start continue and continue will connect to Kafka and then the launcher starts and mustard connects to the agent. So, theoretically, it should work. Oh yeah.

E

Can we make you work I'm, just saying that you know use the computer connector API, which means you need to patch every cloud plug-in like darker plugins every day, okay,.

A

Yeah I propose to take a fun line of line. For example, tomorrow we have a status meeting at the project, so maybe we could discuss it a bit more. There.

A

Okay, so I see no other questions in the chat and yeah thanks again Jason, so just to provide some feedback from the mentor side. Yeah, the project looks really good and we've got a good progress.

A

um Yeah remote in itself is a pretty complicated array, because you need to study a lot of things and we have that's why we decided not to implement cloud providers in the first iterations, because it would make the project even more difficult and if we focused on simple launchers, but even with that it was a serious ramp up and Goodwin was really successful at studying the codebase.

A

He contributed some purchase to remote in itself, and we have already got this budget in weekly and I think that the project is really mood and after the first phase, you've got one thing which was missing for productization security. So now there is SSL encryption and if you want, you can also play with end-to-end encryption, which is also supported by Kafka. So yeah I think that it's a really good progress by the state and enjoy the project I'm, looking forward to see how it gets to the release and adopt it in the communique.

A

Suppan, would you like to say something.

H

Yeah yeah great to see project is on track, and now we had a spend much time with Acosta and so uh looking forward to see the released version 1.0 soon so yeah as I mention he's doing a great job. So.

A

Okay, thank you. So any last-minute questions, I.

A

Had to guess no, so, let's proceed to miss the last presentation so Abhishek will present pipeline is a llamo and our symbol pull request a job plug-in. So this story has to means Abhishek I already.

I

Yes, I'm ready.

A

Ok, so the floor is yours:.

A

I

Are you able to see my screen? Yes,.

C

I

Everybody I am aleshenka autumn working on a diesel project named Al pull request dropped on him, but we decided to change the name to and / / Emile.

I

So I am so I am a third year student from computer science background from Louisville National Institute of Technology in India. I am a regular comparative programmer. I have done two internships as game programmer as well, and I am very interested in automation. So that's what motivated me who punished in G stock project, the Jenkins.

I

So the problem is that.

I

Jenkins pipeline is global DSL and it is very complicated, even as even with declarative pipelines, and the main aim of this project is to define a viable definitions.

I

For the pipeline projects, okay, so there are, there is some prior work to this, and one is Travis family plugin. It runs travis, vimal vimal as gentle pipeline job, and it does not support any extra pull request and also, it doesn't make sense to run any any configuration that is for another platform. Another one is code, ship plugin and it converts steps dot, yml and services, dot, yml, scripted, Python code.

I

These biml files are supported in code shift shift platform and yeah. This plugin has never been released, say. Third, one is Jenkins Python builder, and this this does most of the work, but it is a non Java. Java base tech tool, which cannot be converted into a gentle spelling, is okay.

I

So my project objective is to build a plugin which which you using which we will be able to define pipeline jobs as viable. My mentors are Martin honza, Kristin, whetstone, Jeff, Kirk and Oleg nanochip.

I

Okay yeah so as I told previously that the main emo of this plugin is to define a viable file using which pipe end jobs can be configured. It should also interact with the pocket server with packet cloud. Yet 11 did help also. It should detect some presence of some reports which are present in convention, location and publish them, and it should also publish the result, build status.

I

So design of this plugin, we decided that this plugin will be built on top of multi branch pipeline plug-in because it has a nice interface to show branches and pull requests separating. It can also detect the terrestrial version religions of the in the repository and automatically get them, and is. It also has functions to publish, build status to the repository.

I

So next is convert. We have decided to convert Vimal configuration file to declare the pipeline and we will be used. We are using J caste plug-in to configure the steps and get the step object, to generate a pipeline snippet or for a step.

I

Ok, one more thing was decided that to specify any scripts and user scripts to run, users will be giving only the relative path without the extension of the script and the plugin will detect. If the machine is UNIX, then it will append dot attached to the script and daughter, as it should be called else. It will appended back and the bats will called.

I

So till coordinate 1 we had a push step which, with which is used to push the changes to the target repository.

I

And build and test performed by user-defined scripts called from Jenkins yml file agent Kohn conversation was also there in Jenkins 5ml file, and we were able to have J unit reports, findbugs reports and save artifacts from the wild. Why am L file and a basic interface for converting yml file? 25.4 was available so current features. We have a step configurator, which is based on Jake, asked plugin.

I

This is used to get the step conflagrations from the Vimal file and then convert it to the pipeline script, but it has some limitations. What I I found two limitations? They are that it has difficulty with ennum parameters, but it is resolved recently and it will be fixed in the next release of the gospel. In next thing was it has difficulty with some classes like JIRA test data, publisher, dot plus, and it is not been fixed till now.

I

Okay, so a specific format for Jenkins variable file has been designed and details about that. How what are the set different section and how to consider the job using I am Vimal file will be there in the blog post. Blog post is not ready. Till now it will be in tomorrow: ok, tools, property in agent, section of yml file has been added so that agent will be responsible for the overall configuration of the machine.

I

Some tests for the plugin also has written and I was using manual and indentation and manual tabs to generate the pipe and code and that was removed in this phase D.

I

So the step code generation process is like this is we have a jaybird step here? Okay, sorry, we have a J's unit step here and either wants to do all this thing. So we will parse this. Why am L and then pass it to Jake as configurator that we will get a step object which we will pass to snippet snippet code generator and we will get a snippet for the step that has been defined by the user. You can see here, okay,.

I

Example of Vimal file.

I

Okay, so you can see here that we have a agent agent section here and we have two section here: we can define tools and the type of the agent we want. Then we have a configuration section in which we have pushed PR on success variable. So if this will be true, then the then the changes will be pushed to target branch. If the bail will be successful and all tests will have passed, we have another thing in confirmation section.

I

This is a trusted trusted users which will be approving the PRS and we should start a building. One of them will approve the PR. Then we have a remote sorry, we have our environment section in this we can users will be able to define any environment variables and the credential they are going to use in their scripts.

I

Then we have stage section in which users can we'll be able to define all the stages that they want and how they want the build to run. Also, if user wants only a one stage, only a simple stage, then we have option of. We have a option of one section: it's called steps and users, users can just give a list of steps to run it, and the name of the of this stage will be built in the Jenkins UI.

I

Plug-In configuration okay. So how should we consider the configure so that we can use this plug-in? So we need to define. We need to create a multi branch pipe and project.

H

I

Yeah and we can get a branch source get the bit but fit github whatever, and we can give Prudential's owner depository and the coldest behavior we want and then in builder constellations we have to choose by jumping style by a firewall and save the single, save the job, and we will be able to use the plugin okay and chain for the demo. I have a I.

I

Have a job already be configured and I have built this.

I

Pr PR number three and the Vimal file for this is.

I

Yeah this one we have, we have configured it gender as any, and we have three stages in it first and we have a step called as such will, which will call us script and in build and in test stage. Also we have test and will script, and we have our five artifacts that so that we can observe the artifacts. So you can see here this pipe and four has been generated and.

I

The the Bell was success.

I

I

So plan for phase three is to test multi branch pipe and features such as that webhook support. We want to include web book support also here, so that whenever PR will be created and approved if the build starts automatically and and the part in which users will be able to give some trusted usernames, so that those if those people will approve the pull request, then only the will will start has not been implemented yet. So that is one also one thing.

I

Then we should we want to finalize documentation for this and release the plugin and after the release, we want to support our honey and declarative, pipe and decorative directive, and.

I

We want to support hierarchical report types. We have a report section in in the Jenkins formal file, which only supports XML XML reports for now, but we want all the reports to be published by that section only so that is another thing, and some tests unit tests an ATS needs to be written and automatic workspace clean up when PR will be closed. This feature we want.

I

We also want to support and one more thing is: we want to reflect on snippet generator that it's a function to generate the pipe and snippets and we want it to refactor to extensions it's yeah. So these are the links for literature at and demo project tree or the project repository and yeah. Thank you and thank for questions.

A

Thank You Abhishek, so Jesse raised a lot of questions about the implementation in the chat so Jason. Maybe you would like to ask some of them.

E

Yeah I'm not so much about implementation, just about goals of the project. I, guess that there seems to be there seemed seems to be a lot of different features here, and some of them overlap with other stuff. That's that happens and other plugins or could happen in other plugins. So it just wasn't sure what the overall goal for this was and how it would mix with it's mixed with other plug-in features that get developed in the future. I think that's what most of my comments were about. I guess.

E

Maybe this is more a question for Martin.

B

Yeah, that's a good question. Jesse.

B

At the start, is plug in the initial idea is to is: is to give the user the ability to have a very, very short description of configuring, a pull request, I, guess configuring a pull request, job and.

B

Bring this with the Yama file, where the user would simply declare the very high level I guess configuration options of of running a full week of building a pull request. That seemed like something interesting to have, because all I.

E

Mean I guess he's asking about sort of scope, scope thing with slay comb like a pull request, approvers feature so I mean that's something that that really applies equally to any kind of multi branch project. So it's not I mean it's not really about this particular Jenkins file. Diamo format really.

E

Right so that's sort of a feature of the of the branch source, the get integration, something like that, potentially.

E

A

Sorry good dropped for the call for a second so regarding potential usages, so we have Jesse is right that the features may be available in a multi branch pipeline or in other such plugins.

A

Actually we tried to reach out to plug-in developers to get them involved in community bonding, so they do not have able, and this time and the yeah our discussion. Our decision was that we try to yep.

A

Try to implement an engine are using multi branch pipeline and offering features from there, because a declarative pipeline was one of the possible engines we could like. We could reuse, so we decided that we start implementation from there and then, if people join, if they want to contribute over to Ginny release the solution, it's possible. So once multi branch pipeline supports this, he sure the only thing Abhishek we need to do is to just replace the current custom implementation by one offered by mult inch and that's it.

A

Yes, everybody has some connection issues from the mentors and students.

A

Does it answer your question by the way.

E

A

So do we have any other questions.

A

Not from what I can tell okay, so yeah, well, Martin is trying to reconnect Kristin. Maybe you would like to summarize at the project.

D

Sure so this last period was really exciting. There is the alpha release of the plugin, so actually, if y'all find interesting or want to poke around, you can go to the experimental update center and install it and try. You know using it to see what the features are. There's a memo we just released alpha 2, so that's been really good and I. Guess the more we find out what people are doing with it, the more useful this can become, because you know there's only five of us here.

D

So it's just whatever we're thinking would be useful for people and I. Think Abhishek's done a great job getting that out and getting the gamal Oh some tax all figured out so.

A

Thank you, Kristen Martin,.

B

Yes, I missed part of the conversation, but I think the most important part during this phase was to stabilize the definition for the yellow the yellow file, and this enables a project to move forward. So I want to thank our check, for is his work on that.

A

Thank You Martin yeah and the as Kristen said. The project is available in update Center. Actually, each project mache we presented today. All of them are able an experimental update centers. So if you took plug in the repositories, you can find information how to launch it the project, how to try them and they also announcement blog posts which described this procedure.

A

So if you want to try any of the presented projects, it's already possible and you have for the next phase, one of the main goals will be to get them I in the main update centers so which will be available in public.

A

Okay, do be having any on staining questions. I've got one question from Willie Hafner about kerkovich, EPA plugin, so here's about source code browsing and he asked whether it should be a part of customer implementation or is the part of code coverage epi? So maybe you should you could respond to this question.

C

How the code coverage API implementation, yep.

A

And he also asked whether it would be possible to generalize this engine because, for example, only is a maintainer of warming's plugin and he would be also interested to somehow reuse of this engine in this plugin is possible. At least it's how I've got his question in RC Oh.

A

A

So Willie has warnings plugin, it's a plugin which shows particular warnings for the code, so there are multiple scanners and it would be interesting to somehow be able to show this workings directly in the code. So, if I understand his question correctly, he would be interested to, for example, use the engine from your plug-in in order to show a working cannon particular code to line. Oh.

C

Yeah I think we can. We can do it because the transcoder resolve is an extension point.

C

A

Maybe it couldn't be possible. Oh yeah,.

C

I mean that you add just in my code right.

A

Maybe and my follow-up to that was actually about a feature of each hub so currently github supports displaying warnings in the code directly, so somebody can submit code result to the pull request. So, for example, if we take your plug-in and Abhishek's plug-in, it would be great if, when somebody submits coverage and starts, it would be useful to get some comments etc to the pull request for grandpas, for example, when the code is not covered to Seoul, so will be such integration possible an interesting tool or.

C

I think it is possible yeah, yeah.

A

Check API is just mentioned.

C

Yeah, okay, take it for it. Yeah.

A

Right, thank you for it.

A

C

A

Okay, thank you too. So I guess there is no other questions from chat. Does anybody want to ask something.

A

A

Guess no, then thanks everybody and thank you. I wish crashing you and would run for the presentations, yeah and yeah thanks a lot for all your work. So we are looking towards the next iterations in order to see how the projects involve evolve.

A

And, of course, thanks to everybody who watched this thing is online Meetup. If you want to get more information about the project, yeah I'll just show some links. I do see my screen.

A

Yes, Lincoln say your projects, this oak, you can find all projects here and here you can also find all information. So, for example, if you want to ask more about simple, put the request to a job presented by the shack, you can scroll and here you may find chart each of our projects has its own channel. So you can just join there and just any specific question. You have oh yeah, it's me there then yeah.

A

There is a github repository and the drink and other resources, so Jenkins I hope projects should be a landing page a if you have any questions and yet, as we said during the first evaluation, each student had a blog posts. So, for example, his obvious shakes a blog post, okay.

A

Yeah, it seems the link is broken. Okay, so we'll try to find it here. Okay, yep I plan is the mo I think it was missing the slash in though, and also okay. So here you may see the description and you can also find guidelines how to run projects and such a blog posts available for each project. So if you are interested just use the base materials and you will find a examples and find guidelines, so we can start trying projects even now.

A

Okay, that's what I wanted to share in the end and of course we will be publishing all slides and we will be publishing this video, so you will be able to watch it later. So thanks again, everybody thanks mentors thanks students.

A

So I am going to stop the broadcast few seconds.