GitLab Pipeline Execution, 27 May 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Merge Trains Handoff

Description

This session for Shinya to provide a technical handoff of Merge Train ownership to CI engineers Furkan (BE) and Sarah (FE).

Agenda: https://docs.google.com/document/d/1bxdrGI-ZR-AimuBh1dpLhQbPk8Ks0JAzW8t2SVfnl-w/edit

A

B

Would you guys share your screen and of.

A

B

A

Course actually yeah. This is a technical handover for my strain right. I'm, yes, so like I, should explain everything I know about much France right and okay, so uh engineer so your sorry, your name is foreign. Oh, my.

B

A

Okay, hi nice to meet you you're in CI, yeah. Sorry very far equip yes.

B

Very fast yeah, okay,.

A

Okay, I got it yeah, so your D know that how pipeline works in general like? But you don't know, okay, so you don't know about. Have you ever tried pipelines for markets I.

B

Mean I just strike last week no strings but I couldn't achieve work with my hobby project. I, don't know much about much trains in the levels. Okay, okay, got.

A

It so um alright, alright got it so I should explain flown much pipelines for Marcus okay. So uh you know this is a handover for most reigns, but my training is not just a individual feature. It consists of like multiple subsequent features.

A

One of them is pipelines for March requests.

A

Maybe you notice future that it's basically you specify that only.

A

Accept or rules to specify that Omega T's document, it's amazing.

A

All right, whatever so, for example, this job leadership has her only rule, and then it specifies that it, this job should be executed for much requests. So with this annotation, it's that job is marked as or associated with job. It's included in pipeline for much request, which is different from push man push pipelines.

A

You know like in general, you push your new commit to a branch or whatever its associated with market, or it's a just branch. You get the pipeline.

A

For example, when you push her and come into master branch, this buildup is created right and but markets pipeline is created created in.

A

Creating different events.

A

Created by a different event, it.

A

Technically triggered by get push, but it's basically associated market update, asynchronous service. These are much this: a worker code markets, refresh worker refresh and a refresh service, and this worker is invoked when get push happens, to a monarchist and in this asynchronous process, this pipeline for much focus is created yeah, so.

A

This is one of the.

A

Prerequisite to enable mush rains without this quick sample is like only module casts much trains cannot be enabled in the next feature is parkland, so master result, and this also needs to be enabled in order to enable my strains.

A

This is a basically you need to go to the project settings and enable the checkbox, maybe I'm, gonna, show you I'm gonna demonstrate how to enable my translator and including this sub-second Southlake in features, but basically this switcher, to enable this switch that you have to visit project setting and in this pipeline is basically similarly pipeline for module request, so basically is created at the exact same event.

A

You know when you push your commit to your branch which associated module request pipeline for module gets created, but if it meets it meet certain conditions pipeline for must result must result is created, which is more.

A

Like which is better because it gives you much more accurate result test result because pipeline for module must result runs on prospected must commit.

A

Yes, do you know that much like there's our internal much request refs in give up like.

A

For example, clicks of this one left smudge records swash I ID and it's rush marsh or that's much wicked, slash head.

B

That's the first time I see this yet.

A

So this is our eternal get ref and the user basically is not our obvious internal. Perhaps it's it's used for our purpose. The internal process, for example, Piper and for much research, and we have a special ref here, like a riff swatch market, / marché, which was introduced a couple months ago, and this commit this ref is basically updated.

A

When you push a new coming too much request, you know when you create a modular cast you branch off from master branch, and then you push your more comments on to the module request, but your branch may be might be based on the old master right. If you haven't rebased and in the result you get. Your pipeline runs on old master so that the risotto pipeline is not really trustworthy and then a pipeline for much result comes into play. When you push a commie too much request, this refs mantra get /.

A

Marché is automatically updated even before you like someone, maintainer clicks a marsh Bowden. This is a project, a prospective Mars commit and it's a it's generated by head head of master branch and head up your future future branch. So yeah it's a prospected, much coming and yeah, so that's a pipelines for most result and then next. Finally, we talk about my strains so.

A

However, used to my strains like actually it's enabled in wwg lab /, calm, ee-ee-ee-ee lab calm, but you have never try to update it blog or something. No.

B

Actually I mean I tried to use much trains in this week and I couldn't make it because okay.

A

B

Of I did I didn't use only merge request in in my pipeline, so I never use it actually.

C

Virginia I think I also have a video on unfiltered all add it to the agenda. Alright,.

A

That's better, that's better yeah, to be honest, I'm I'm, really confident to explain everything properly. So yeah.

A

If you have a question, please let me know so. A mastering is basically extending the future of pipelines for mass result. I.

A

Said that pipelines for mastery result runs on prospect. Prospector to merge, commits that's great right and and then imagine that there are bunch of markets on on a train in a 1q, and it's a like a user scheduled to March. This Marcus.

A

Sorry, that's not pretty explanation.

A

Here here maybe do you see, explains example,.

B

A

Okay, just read this like it's really magic as a B and C are already too much training order, which creates very much results. Five lines that run in problem. The first pipeline runs on the changes from a combined with a target plunge so like in this case, for example, master branch, the head of master branch second pipeline, runs on the changes from a B.

A

A and B combine awaits a target lunch, so much arrest a is based on head of master and head of head up a and Marcus be based on head of head of Master and head of a and head of B. So you know cos is a cascading prospective Mars Mars commit it's a super complicated adapter, the mass merge commit, is cascading recreated for each pipe and for each module cast, and the salt pipeline runs on the changes from a B and C, combined with a target target plunge so like see.

A

A

The pipeline for miles training runs on the head of head of master plus head of a and head of B and a head of C.

A

A

There's a peplum, so he fails it's removed from the Train yeah. It's a pipelines for B fails. It's removed from the Train. The pipeline for zebra starts with a and C changes, but we said there be changes.

A

Yeah, this is a bit tricky.

B

Previous pipeline canceled right.

D

B

Mean, let's say pipeline see I mean the third pipeline is going on, and if the pipeline bill fails, while the third pipeline is going on, it will cancel right. The third pipeline will be canceled and the new pipeline for this tea starts. Oh yes,.

A

This rats- these are visual illustration for this process. All right, do you have a blog post that link to the blog blog posting.

C

Yeah I'll add it here: I added it without added here is.

A

A

It's a great blog post to explain these things.

A

B

Yeah, you start to take the technical part of this. If you want. Oh really.

A

Okay, that's great so just yeah. What are you talking about? It said just so. This is a picture. Oh, how what's gonna happen. If much Wieck is three the pipeline or much recklessly failed, it's basically dropped from the marsh rain and then the next mark is for its restarted, with Marcus one and Marcus T plus Marcus, for.

A

A

Here's a brief technical overview of these. How these future works, how I planned so much because pipelines for Marcus is as soon as known as detached a Marcus pipeline.

A

So if you heard de charged, it just imagines that the eight points to this feature and it works like user purchase. A new committee modular cast and again Gilliam refers refreshes related markets, Pierre refresh service. This is a synchronous, a processed beer, sidekick Walker and it creates a pipeline for March requests.

A

Your logic is: create a pipeline service.

A

Yeah so drilling this worthless process, its create a pipeline.

A

Yes, this one and which calls Marcus create a pipeline service and it is calls CI create a pipeline service. This is our core service to create a pipeline. You know, well it's pretty much it the next. Why is a pipeline pipelines for March results? This is basically created in the same process same floor, but it's basically.

A

Calls ee ee side of Marcus create line service and.

A

Here it's basically it's a.

A

It's basically ensures that monster F internal, much ref this one. It's worse much, we case wash Eddie Marsh. This process ensures that this prospected much commit it does exists before create a pipeline and then, if it exists, then create a pipeline on that Ref.

D

A

And the necks of my strain works. This is more complicated, so yeah, sylia, I, haven't finished, editing this, but try to explain so user clicks or monitoring button. You know Marcus instead of our much immediately put in and if it happens, it calls autumn our service and this service or the Marshal Service is our central place to maintain all automatic merges there are today. There are three type of both modules. One is Marcus very much when pipeline success. The second one is my strain. The third one is attitude, much rain, wimp and blind success.

A

The satellite is kind of combined with the first and second process and.

A

This, the wins user clicks a button. The execute is a this method is code and which calls this subsequent service Oh too much much train service. And then it's basically creator database record here. It creates a new record in mastering stable and which has one-to-one relation your relationship with smart requests.

A

Yeah then there is simply put if Marsh recurs. Much rain is present. That means Mars, Ray Marcus is on train.

A

When this database Association is created.

A

The process is called.

A

Autumn arch process autumn, our service process, so this basically process what's on, like processes Marcus on mass rains and then it checks. The details in in this details are in this class refresh Marcus. This Marsh rains refresh market service, though it basically checks that if the Marcus has already had a pipeline for mush rain, then just waits for the path line. I have a question to interrupt.

B

So every major major against has a nurse training right, so I mean I thought there is only. There is only one night train, it's blocks the project and each merge request has a car I. Just imagine like that, and it just I just surprised. It's.

A

It's it's very good, good question, and this is not the first time I'm asked and it's I really understand your concern and then so. The answer is that basically Marsh trains, this record.

A

Yeah this table it's considered as metadata to or mush records to so this represents that which pipeline is pipeline for Marcus to our specific match request and when the Marcus was added too much rain and or targeted project ID and status like it is Markus is currently waiting for pad line to be finished or if pipeline became still, then this market should be refreshed on Mars rain or something like that. It's a kind of metadata to each moderate guest. So uh yeah, that's a that's a confusing point. Yeah.

B

A

100 100 person to agree with you, ah but it is what it is today.

A

Yes, so if there are five Markus on a mush rain, that means there are five much rain spray code.

A

D

B

Connection will just drop that I can hear you right now.

A

Alright, yeah yeah.

A

What I said was just just if there are five major requests on a match train. That means there are five records in my strain stable because it's just metadata to each much request.

B

Store order in this much trains, so just it is just ordered by create that yes,.

A

This is a single table is used for mass trains, future.

A

A

Maybe I need to dig a bit more about the service refresh Mario service. This is.

A

Okay, let me try to explain this class.

A

These are mass trains, reflash March record service. This service is to reflash all up their markets on a specific train and.

A

Yeah, so terror.

A

Okay, so these are a couple of objects: ada exclude exclusive, lock process, but just disregard it. Basically, what it does is getting a first mahuri caste in a match, train and refresh all of the markets. From that pointer and answer in this Mossad unsafe refresh, it gets all the following Marcus from the pointer and then runs this with lash marks record service. It does a bunch of evaluation and validation and the creating pipeline et cetera, but it's basically like in generate brief flashes. Each much records on train.

A

Yeah it in this service, this reflection, moiré get service like.

A

At first they're, a bunch of validation happens. For example, if my string is disabled on a project, then all markets are going to be dropped from training or like they are a bunch of partitions here like, for example, like much much of my zero state check like if.

A

Like there's, a Marcus is on a much train, but someone created a new discussion on a matter. I guess then like it depends on the project setting though, if like either can set up that, if there is a, if there is, are open discussion, maintenance cannot March the Marcus so in that stays. In that case, this this check returns false so that the module gets is I'm going to be dropped from that train.

A

It is a a bunch of other variations, quick, simple pipelines, pipeline status check when pipeline finished. My strain, of course, has to iterate that if the pipeline succeeded- and if so then, let's continue you Marcia.

A

A

In a digital disservice also ensure that each module caste has her pipeline for mastering it. Basically that.

A

Like like, like the blog passed, we saw that we saw visual illustration in a blog post at each module. A guest has a combined ref and pipeline dedicated pipeline on runs on this combined Rev and.

A

Up to 20 mantra cast pipeline can runs simultaneously.

A

So, uh yes, sir concurrency set up the default concurrency today is basically, for example, if user added 20 module gets on a train, all Marcus starts running a pipelines and then.

A

When a pipeline finished from the first queue, the market is getting merged and a 1 2, 3, 4 and 20, but if user additive 50 markets on a mulcher in the first 20 gets a pipeline, but last sortie mantra caste doesn't get a pipeline immediately because it's got a poor man's concern. If you know try to avoid the pipeline burst because running a pipeline, sometimes running a lot of pipelines, cost a lot of CI cost. So today we limit and 20 at most.

B

30 pipelines are I mean will be created right. It is anchored in somewhere yeah.

A

So let's say in this: like a 50 markets case like at first they're like first 20 much weakest gets a pipeline right and if the first part much work is it is marched. Then the number 21 Marcus gets a pipeline. So it's always 20 Marcus I get the pipeline.

A

B

Mean ok, 25 pipeline are just running right now and there is a 21st merger. Chris is created. So what will happen? I mean it is I mean let's be created when when I merge, merge train is merged or it is just dropped, I'm not sure. If I could explain my question correctly.

A

B

Rephrase it please ok, so there are 20 March trains running right now there are 28 pipelines running there is a. There is 21st. Metro case is created right now, so there is no pipeline created for this right. Yes, so what I mean? How about I mean II is the pipeline is include somewhere to be created later after an empty slot open.

A

A

Basically, it's.

A

There no enqueuing, like you like you guessed it basically that when the first mantra caste marched gut-punched, then this reflash of is is code again, but they say this is a synchronous worker and they eat. This service always ensure that there are always 20 pipelines run on this moisture.

B

Okay, I just I, just understand okay, so this dis servers will create the NIV, merge trains and the new pipelines. Okay, I just got it. Yeah.

A

Yeah, so these services is super convenient. Just you call this service, then you can ensure that all much I guess up to date, and so basically, this service is called by many events. For example, when pipeline finished or when module gets, the dog dropped one man when markets is added. Well, when project is project, disabled smart rains check box yeah. In such event, this service is called to ensure that all module guests on the mush rain fresh up to date, yep.

A

A

There are a couple of sub sub sake and features like canceling pipeline. If it's really done redundant or.

A

Yeah, but it's not really important, just like I remember that this service is a single place, t-handle much focus on train, ah so maybe I give you funny. Example: I.

A

Said, like I, said much trains in a boat on w TT, get lab calm project and.

A

Sometimes it's stuck my screen gets stuck because of like a production instant like you know, it basically realized on sidekick workers. So if sidekick that work, it doesn't work properly, then like system gets stuck and like, in that case, like here's, a much much range channel and then like I, get a pink from the www. The employee is that hey my shrine on this project doesn't work, pretty check it and then yeah I do investigation, though, so my point is that.

A

If it's stuck like I, said just call this service, this service is basically code by this automatic process. Worker.

D

A

Like yeah, this just gets a project target project and then run this worker project. Mushroom, yeah and giving the first mantra gets on the train. You can get the marshal riggers the pointer this code, project, much means active, active means still on the train. There are two states active and marched mushed. It's already getting got, matched and activates two on the train and the first of course, in the Marta request. Id. How do you just pass set?

A

Get a Markus ID. Then Otmar lobbies cause disservice refresh market service. Then it's examine or Marcus on the train and then, if it's stuck, it automatically resolves it.

A

B

If this is, if this hack, it's the stock train, why not I mean why don't I knew merge, request fix this stock train I mean so I mean it will eventually run business service right, yeah, yeah, yeah, that's also a good question. So.

A

um It's related religious service, refresh market service.

A

So imagine there are three markets on the train. I think you add, a new module gets to this train. So this is magic number four, when you add a much work, it's number four. This service is code, but it doesn't refresh all of the markets. It reverses markets, only Mars records for number four only, and so this smart request is a pointer from which markets do you wanna refresh it.

A

So if you add a mushrik, as for from the reflash happens from their March records for and in like if they're like six months back, it's right and then pipeline finished on Mars Bacchus. For then this service is called. The point is Marcus for and the reflash is four five six and one two three: it's not.

B

From the modulus- and we want to refresh from the first one- yes.

A

A

So this is a reason that you have to specify the first match request on the train and here so that you check all of the Marcus is basically this.

A

The conceptual reason instead to reduce that process, time redone during the process yeah it basically needs to process from that Marcus got get an event, something event like a pipeline finished or whatever things, and so yes, it's designed like this. This way.

B

That I mean aims to solve this problem. Yeah.

B

Okay, so I mean, but you know, what's the what's: the cows.

A

So I don't have her clear evidence, but I suspect that it's related to do production incident.

A

Yeah, like it last time, happen it last time it happened a week ago or maybe in two weeks ago, something like that it like at the same time there's a product, instant, so I, basically suspects, okay, yeah, but but I don't have a clearance. So what? Basically? What proposed in this issue is said? Why don't we have a chrome worker to periodically check the health of Mars requests on the trains and, if it's considered at a stock, then just run this service, so it won't automatically result.

A

A

C

In yeah, I have a question sure, so we have a merge trimming and we have a bunch of merge request, let's call of them a b c d e and they were all asked to be merged by sequence. So a was first and ian was last. Let's say that one of the merge trains is faster than the previous merge request, so I have B and it gets merged before a is that possible and what effect does it have.

A

No, it's impossible, like there's a possibility that the pipeline for Marcus be finishes area than pipeline a, but in this case, pipeline Americas be waits until Marcus aids, abbreviation finished so like. If Marcus a cut marched by successful pipeline, then Marcus be almost immediately get marched. If it's the pipeline also successful and if Marcus a Cadfael pipeline, then Marcus prek-8 you pipe for much train because you know combined Ashraf has to be regulated. Yes,.

C

E

A

All right, so just we walked through these code base, but um yeah I think that's a that's our overview. Let's move on for now. If you have a question, please ask him: I.

B

Know it's a quite complicated issue, so that's why I I mean I'm not expecting to understand all of it. So that's why I don't ask too many questions but I just I'm trying to ask specific questions for some parts. So it's really. It was a little wrap-up for all of these features. So thank you.

A

Thanks: okay, let's move on issues almost reigns. Issues are labeled. This category much reigns. So please shake it. There are a bunch of issues, but I think nothing urgent. At this moment, I think probably this issue is relatively high priority because yeah, sometimes the employees complains that hey much because they're stuck in TT able to delegate Lancome so to about that, maybe like it. Currently, we manya manually reso Piatt like running a script like this, but it should be automated yeah.

A

B

Is this one of the reason that we don't use no strings in the developer, know.

A

But these are different reason. So currently much train doesn't support for much request and gillip project that our relatives project accepts their community contribution right. If we enable my friends, we cannot march the Americas. So that's a problem and there's an issue to fix it.

A

A

Yeah there's an issue to tackle the problem, just in case a mr. here and basically, when we ship to this feature, then we should be able to enable my trains on wwe.com.

E

A

It's a it's a category so release. Probably we gonna, we gonna undo that yes, yep and /aa know is. If my shrade's please join this channel yep. This is super important channel.

A

And do we use this featuring yeah.

B

You're the answer, the question right.

A

I try and keep calm and.

A

She's ah sorry like it is a history on wwe.com that we try to enable much trains for a couple of times, but we failed like first or second time for a first or first and second attempt, and because of that, we have a large system like if my strain doesn't work properly, then set a notification to this channel. If my strains and the a larger system is basically here, it's super.

A

A

It's basically like getting my strains: Rico's pure puppy for public API and then, since each mark strains table, has a duration like how much time tick too much too much requests. And if it's unreasonably long duration, then it gets its sensor notification, for example, duration, much rain yeah. This like get up this project exceeded the threshold. My situation is like almost two hours: much work as URL, much trains, you much training pipeline, URL and currently threshold. It's set to 50 minutes yeah.

A

So, for example, in this case, through this smart I guess it's marched already, that's nice, but it took two hours to get merged until from when user clicked to attitude my stream button to actually this much work is cut merged and.

A

Basically, all pipelines finishes within 20 minutes in this project. So it's weird right. The reason is that, for example, in this case.

A

If it's pipeline for mush rain, the comic comic message is speed, different from the others, and then this comedy message miles: branch, blah, blah blah blah with rift la blah, blah blah train yeah.

A

This salad comedy message indicates that it is pad line, it's a dispatch that was pipeline for mastery, and you can see that the same pipeline pipeline for mastery runs twice.

A

This is because the one of the magic guests sitting in front of this Marsh request dropped like a pipeline failure or something, and then this market has to how to recreate pipeline for Marcus a pipeline for mastering again so that it burns a second of pipeline. This is a reason why sometimes Marcus gets a long time to get marched again. Just gets two hours.

A

Like at this kind of warning, is you can just ignore it unless user I own this place.

B

We are developers to be ignored, warnings.

A

Of course yeah, but seriously you but like sometimes you get a warning like this, but unless employees especially like working on wwe.com, like updating handbook or whatever things, unless they complain that hey Marcus, my marketplace is still on the train and doesn't get marched and the such complex happens, you don't need to pay attention. Actually it's going to be marched anyway, so yeah at first we were receiving a lot of complaints like cuz, sir yeah. Previously, everyone could Abraham was able to just March all Marcus immediately, but today they have to follow the marsh rains.

A

So yeah it is it's a bit. It takes a bit of time to get there much. We get smushed, but today, I don't see a lot of complaints.

A

ah And by the way, do you have a rail Leyland's console access to your production server? No.

B

I, don't actually I don't want to take it if it is necessary because it's really risky thing to have the production console as far as I know. So maybe.

D

B

The if there is something to start, maybe I will mention to run this code in production channel or, if I can't channel to someone else from this. It's.

A

Totally fine and yeah good practice yeah, but I do not recommend you to get that production access because it's a it's. It's very helpful for daily debugging yeah. Well, but it's up to you yeah and I.

A

Don't know some all the snippets but I think it's not really important, just a like a correcting matrix of my strains, but it's not really important today. Just maybe what you need to know today said.

A

This one like when how what what do you should do when pipe much? What gets stuck in GG applique let go. This is probably all you need to pay attention at this moment and I think yeah. That is the incident. It doesn't happen so often so yeah, but if it happens, please just ping me I might be available around that time. So I can help you.

A

Blog post, any videos.

A

Yeah, it's worse reading this I.

B

Will take a look? Oh.

A

A

And maybe that's it from my side, maybe maybe we like you, you work on any you work on issues on my trains. You have more questions in that case. Please pick me in issues were it's luck.

B

Thank you so much for this explanation. I mean as as I just said before. I don't I mean I'm not expecting to understand that fully right now, but it is a great thank you for this yeah. Yes,.

E

Thank you, Shinyoung Nathan walked me through the front end of this before so I had like a little step up, I kind of knew what it did, but this like means it's so much clearer. So thank you so much yep.

A

If you have a question, please let me know.

B

B

Okay, really, thank you. So much see you later thanks, bye.