Magento Cloud Community, 23 Mar 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Magento Cloud Grooming - Cloud Docker 3/23

Description

Public grooming for Magento Cloud Docker project.

Board: https://github.com/magento/magento-cloud-docker/projects/1

A

So so, essentially we have a board. So at this time I will try to go through the board. We will try to use and figure out. How is it usable?

A

You have automation, progress in process, so if, if you eventually, you pick up tickets and they have been moved with different statuses and be enclosed and the pull request in post, the ticket will be reflected as well, so totally some kind of automation. It is not really perfect right now, but hopefully we will improve it with time.

A

So, let's probably start with the pull requests which are in progress right now and now we have a nice pull request from the you guys for fixing conflicting volumes, this probably already reviewed and PA in progress by Andrey.

A

There was only one question about foundry regarding supports, but I suppose we showed that much of a change for eventually I would say that this pull request does not address this issue and it does not suppose to so. My comment will be we can go on with this and we can follow up and create click it for this particular issue, because currently I really agree. You smell that having multiple of firm docker projects running locally is kinda overkill, and probably we need to make some adjustments to make this work.

A

Of course, it's it's consumed a lot of memory, and it's not currently very usable.

A

Does anybody have objection regarding this point? I.

B

Think multiple when running, multiple projects, I'm not really having multiple projects running at one time, so, for instance, I'll I'll shut down one project before then next, and that with problems with the port, I think one simple way to simplify the problem is to just shoot for being able to run multiple projects just one at a time. Instead of simultaneously.

C

That's what this ticket actually allows for it adds a prefix to the volume names so that, when you down the ball, the containers it doesn't have to the volumes, don't conflict between projects. As long as you change the name in magenta yeah mol from from my Magento to something else, they won't conflict.

B

Okay, that's good.

A

Yeah yeah, okay, so orderly, please finish, is a key activities and I think we're pretty good with this very useful.

A

Next one was eventually a pretty interesting but problematic chicken. Some weight pool request from us from utopia, geyser Gardens their website support in the cloud docker and I know it's a matte also wanted to discuss this ticket. So eventually we just admitted follow up on the story. So, as a fix is pretty simple and I can just open the pool craft which was deliver access.

A

So the fix is pretty simple and pretty obvious.

A

We just add the out opened fire on to the pitch pistol, which be a dot ini' configuration file and it works. The only problem actually is this approach that, for some reason in our containers, it's driving the warnings which are eventually in some way being converted into the exceptions. So this file is included multiple times and I.

A

Honestly thought that is a problem is because of my way of testing when they are using docker compose override file, but the sin that once we built this images under Kirkup and I just had to look in the pull request into github, which eventually uses that the images which we just built it showing the same error. So it was not my local problem. The error that.

A

Images are broken, and this shows the error which actually says it.

A

It is but I cannot record each HTTP host, separated I wish to declare it so, and I honestly doesn't know was there is no this error for some reason, image include this file two times and I wasn't able to currently figure this.

A

So it's not book actually people for who using the old branch and the mostly use it's not the block. Is he sensei? He see patches in delivery process. We decided to country at all back this change and wrote an issue because it would I think.

C

We're going to change the way we're doing this, we'll put it into a different ini file, I think I.

C

What we'll see like, but take it out for now and rebuild your images and then we'll figure it out and get you effects for it. It's really weird I've.

D

C

Don't know why it's doing it twice: I did some googling and I. Don't see anybody complaining about this, it's kind of specific to our docker images, so I'll play with it and figure it out. Yeah.

A

So this pool quest sorry, this issue is to open it and under 104 ID, so eventually the other guys into this and happen. If you guys need any help, please feel free. We have some capacity to help with some digging into the next one is in our Boocock. Is dr. Campos fails if multiple users from a scale configure it so I know guys from zilker. Also, yes, yeah.

C

It's assigned to two Oleg, so the developers held off on starting it.

C

E

A

Cases yeah it's very interesting because Matt I cannot behind you in this.

C

Pseudo, a a EP, OD and plus I only have one.

A

C

A

But for some reason, I cannot find the inner side I'm.

C

Matthew without.

A

C

A

C

1T Matthew.

C

Yep and then a TW like Matthew, with only one key.

C

That's so weird: okay,.

A

Give me possibility to silence tickety yeah.

C

That one and then 168 as well that they're ready to work on both those.

A

C

Was like a health check, one.

A

C

Additional health check sits at the bottom. There.

E

C

A

Specific person from your team who is working on this issue.

A

Yes, a small date actually for if he remembers our maintenance initiative, so we will try to move forward this, this week's. So you guys we look at the specific rights and there are two guys from zilker. Google will get the permission. Stone actually assigns us tickets at moses ticket, so I will not I mean we'll figure out. The problem is.

A

Okay, I, don't really know what's happening.

E

That's fine, as.

C

Long as you're not going to work on them, no work, Adam, okay,.

A

A

So there is a draft for me draft for the technical vision, I still actually working on this, so we will skip for now the idea factory to to describe the long term and short term well for this projects, and we will discuss this internally in this week. So we want to move.

D

A

Kinda move this project into some unified solution for all of us. Imagine developers once imagined to power developers, so I think I will have more of Dave to just take it later this week.

A

But if you would like to browse it, it is kind available. So you can already start writing some comments.

A

Next one is eventually we started trading dogs tickets, so ticket number one five, six and the idea is actually to to cover part in our double dogs. How to add custom elasticsearch plugin introduces a elasticsearch. I was a container image so because there is no automated way, you will you just describe this and to create a full request into dev dogs.

A

That's is in good any objections.

A

You can see this stick is in ready for the opened column some and if our capacity please feel free to take them next is pretty pretty similar, but we have some kind of functionality for this, so we have PHP extensions class and eventually this documentation update will cover the flow, how to edit custom extension to our docker images.

A

So whoever will take this just create the proper full request into the docs and describes them flow, xavier. Any extensions.

A

E

A

C

Blue stuff there, so we can. We can just like develop that a little further. We already have something very close to that: I think that didn't get pulled in during the you know, merging when we, when I redid, all the docs. There was a couple the champion, so I've got something for them: cool.

A

So it's moved to Rio for the Ottoman incepted feel free to pick it up. Next one is adding new version of existence. So actually, if you know about the house, the coral corn right now so they are in very I- would say fracture modes. They update union new ability, business services, a edging elastics chatter server to the edge in Mary, a DP new version, whatever one sorry ten point four, so they I think a lot of new services and eventually we want to be on the same track.

A

Probably in this task, we will have to create how third party developers can add new services or new version of services to our cloud dock resolution, which is not big deal but and we need some kind of I.

A

Need any objections in this stuff? No.

C

That's another one say very similar: I had to figure out holiday that do the last week search ticket recently.

A

Okay, this one this one separate from this dogs eventually, eventually, if you remember our model to cloud.

A

There is a possibility to programmatically specify what kind of elastic search plugins you would like to use. This is a kind of a nice feature, but this pretty this pretty much development efforts to internal something similar, because you know you have to pay some resolve and so on so on. Well, so we decided to put this ticket into the whole community book lock. If somebody would like to take care of this, it is available for picking up yeah.

A

So any objections to this ticket.

C

A

This could be pretty complicated, so I would not rush with the ticket because, like they were, the daxing update will be much simpler, but eventually, if you feel like not capacity, please feel free to take this.

A

Next one remove HP requirement for P or the person built. Okay, I think this one has a lot of updates.

A

Eventually, the idea is I seen to have out-of-the-box.

A

C

Really solve this so I. We do this. Often this building inside of the instances I there's a command there. That shows the docker command and then somebody use that same docker command and added some shell scripts that run like the Magento command inside of docker and so on.

C

It's a good way to do it, but it really is.

C

It needs to be scripted like we need to have publish yeah exactly this one yeah. This.

A

Is what been embezzling from our team and it recent, and we imagine so existing added the script in it, dr. shell, which has some logic very useless if I, what kind of fashion you want? It has some logic to as.

C

Same thing could be done like the handle the composer install inside of the container.

C

However, it just gets really tricky and then I know I brought up an issue I found over the weekend where, in the images it's setting up the dot composer directory, which means that it can't be brought into the container correctly unless you specify it every single time. So, if you like do a docker compose run, you have to specify the composer directory and it doesn't always yield to it either because of the way. Yes.

A

A

C

Doesn't actually work yeah, the cache doesn't actually come in when you do that. Oh shoot.

F

C

May it may but like if you had an off it won't work because docker when you declared the composer cache it created the dot composer directory above it, and it doesn't allow you to mount to it. If the volume is declared in the docker file. It's.

F

It's creating a fine for the cache. Then it blocks the composer volumes that you're saying yeah.

C

You can't have volume inside of component side of docker files right it like breaks, docker compose it, the the sucky thing about. That is that if you are running docker commands, you have to actually do it yourself right good, like you, it's like, if it's in the docker file, the like it has to be exactly as it says it is otherwise it won't work. You can't like override it correctly. Okay,.

F

So if we try and make sure that that volume flag matches which, in doctor with that Kirino.

C

You would take it out of the dockerfile. Take the volume out of there like well. I was gonna, make a ticket that describes all this anyways, um but yeah we got to take it all. The dockerfile, like you, still be able to Clare it and use it and stuff we might need to make the directory to like.

C

Instead of just like declaring the volume you make their directory and then in docker compose it's already mounting, you'll have to mount it there right, if you so that we have it in docker, compose override where it's, where in before this change was put in, we were just mapping the composer directory and so that it got off, and it also got the composer cache directory.

C

C

Yeah that right there, that line.

D

C

Like brakes, the brakes mounting volumes in the composer you can't mount to composer off. You can't mount to anything because composer didn't actually exist before that point or something the dot composer directory, so the volume declared out I, don't know it definitely doesn't work, though anymore. So I can't like every time I build with with composer inside of a container. Now it has to reget the whole cache.

C

Yeah that way, it hasn't.

A

C

A

This created, oh yeah, no.

C

I I'm a team before busiest for himself.

A

Okay, but overall, does this pull request and this nice shell script? Does it suppose it ticket a joke created previously well.

B

One one roadblock I think a lot of people experience with running things inside the containers is is managing authorizations so, for instance, an SSH key or a composer authorization setup and and variable outside of the containers, sometimes causes these things to fail. When they're run inside the container I I don't know. If anyone believes that you know totally eliminating PHP from the build process is possible. I know it sounds crazy, but if anybody has a good idea for that, I think that's more. What I was getting to.

F

C

Think that, with a little documentation, we can show people how to map in their authentication and their and their SSH keys correctly as long as we get it working and then it works really good when it works like that's how I was doing all of our builds and it was recycling the composer cache and everything was awesome until that volume got there so you're right, it's a little tricky. The context thing is definitely tricky, but it removes the PHP requirement in the VM or wherever you're doing it.

C

The one place it really doesn't help in some ways still is windows because yeah this solution has a shell script and honestly I I, don't I, don't necessarily care, but.

G

C

The windows portion of this project has far greater issues like it doesn't. It does not run well in windows, native docker.

C

Desktop like until you address that I don't care if you have a way to instance, it exactly without you know, running running PHP or whatever, like you're, on you're you're kind of on your own. If you're running Windows, the the way they suggested and I think the documentation should really reflect is that people are using a VM in Windows. If they're running Windows, they should be running inside of a VM on their own. They be using docker desktop because it works far better, and then you can use these shell scripts.

C

A

There's a directory, some updates to the Linux subsystem for Windows, which actually had some kind of brain start or whatever or a Linux build. But if people go such a far our Staton's to make sense going, it will be easier to just install some virtual machines so yeah. It's.

F

That ticket that the Linux subsystem for windows it it it wouldn't totally resolve everything like the host spot may be fixed there. I wanna real fast me over time with the some of the flaws of the the running donaka commands. I I may have been making this up, but isn't there a way to forward environment variables from your host environment into docker, and that might be another kind of small fix for the the off issue, or is that something that I I'm misremembering know.

C

That's true and I was looking at that like so we don't leverage, you know EMV at all, like a lot of docker projects, use dot, E and V and and use those as and then any variables, also in their environment, but like okay, so I work on multiple projects. The problem I have is that my composure, cache I'm.

C

Okay, with that being the same on every project, but I'm, not okay, with composer off being the same on every project, so I have to actually switch my my local, my local environment, to point at different offs right.

C

I asked after Jason like because, like one client has these enterprise keys and and whatever for their back-end, and this other client has different ones right, I can't build the with the same keys, but the cache is fine, so I map those in I just like in in the docker compose overrides you just map it into the right file and it can be named different files in my dock composer I actually have different two composure or off json dot, client name.

C

You know what I mean like one for each client and then I map them in so an SSH keys tend to be shared per developer, so you're one developer and same with get commands like you're you're one person so like your get credentials typically are always the same, so it works really well.

C

In that context like I can work on multiple projects and have different composer oaths and have might get keys the way I need that or my SS h keys, and I think it's just a matter of communicating that process and then making sure that that that we can actually map the the composer directory correctly using docker compose or these like docker commands and then wrapping them in scripts.

A

C

Like say, for instance, you had a separate off that you needed to use or a separate directory. We could have a flag on the on the script. That's calling it that allows you to use a different composer directory locally and define what what that path is sure. So.

F

C

The edition yeah so there's definitely. We definitely have ways to solve this. With this with this method, and I really encourage us, even though it's more difficult for developers, we're like one of our goals should be to help them understand. Docker they're, you know like a lot of them, are coming into this they're new and we kind of if we could help them understand. You know what docker docker compose and what the like I find that that's super helpful helpful for the developers I'm working with, if I just explain what the commands are doing.

C

Alright, you know I mean, instead of just trying to fix the problem, so um that's part of the reason why I have not made any shell scripts like helper scripts. If you look at Mark, Reuss project or warden you'll find that there are hundred or more of these helper scripts doing these, these jobs and I'd rather see us going sort of less, is more and and teaching people how to do it and letting them build what they need from it.

B

Those scripts, though, are the most effective way for people to learn because they can see what's going on in the minds of the creators that created the solution, they're, not an impediment to learning. Oh, that's.

C

True, although in both cases, you'll find that they're so opinionated in the methods that they're using that they lock you in where we don't have that luxury, both warden and shoes project like lock you into a very specific way of doing it, and so do we, but and I am NOT against them either right like if that, if we want to go that route, we we can, we can just define what scripts, what helper scripts we want and we'll make them real, quick.

C

It's not that hard and I think that that's a that's a totally valid point that it would help them learn. But we have to be careful is what I mean, because the scripts are our opinions and people will use them.

A

As a mock show, sexually uses different approach improperly previously somewhere discussed this and because it doesn't use just sinkage and it doesn't use the cursing. So eventually, you can await the script it which just copies of all files from first machine to the docker, and so this, even if different approach I, would say to the magenta development itself.

A

Okay, so I think I will keep this ticket open. Let's finish, discussion is bad and let's fix the volume part in dockerfile and probability in the cans and about our opinion. Regarding this, and probably do you know.

A

Anything else guys learner's ticket.

C

No, this was a really good first effort. I I appreciate it in like we'll just have to continue add into it.

A

Okay, so this one interesting as well I think I saw something similar, which is database. I, think this has someone has seen the same root cause because we it does not handle properly such complicated young constructions.

A

So the case here is actually, if you specify a platform configuration in your Magento PMO, the built will fail, and then you have nothing yet even I know that we actually removing the fire support. We still this construction will still exist, so we need to fix this case.

A

Any I see a man coming from mattress place and she requested a in physical possible to use.

A

Okay, I need particular questions to this ticket.

A

Think I'm moving ready for development. Please feel free to pick it up. Okay, next one. What is this.

A

Oh, it's strange not sure why sorry, no support, because it's already solved, give us a good multiple project is different volumes. I think this is what guys currently fix it yeah. So this is one in progress.

A

Yeah this one is good.

A

Let me just put it into the progress.

A

I'm really not sure what happen is my sign a little because I like really cannot people.

A

Okay, next one was this one, uh not sure if we can do anything, secure connection works with warning regarding certificate, guys, maybe heaven is in for this ticket, because I II was trying to investigate they say and they haven't found any way how to make browser work with a self signed certificate action into the darker.

A

Guys they have any anything regarding this I.

B

Can't remember if I've seen that, before or not.

D

Hey, can you hear me this is sandy yeah I had actually looked into this and I actually found a couple of solutions that could possibly work, but it was different based on the operating system. So there wasn't one single solution that we could use to solve. This solve this issue that is operating system independence, I'm, not entirely sure. If we can do this.

F

Yeah, it was good, but it's too, since the I knew sort of a little bit about that up. My system issues well and lots working on that that show sucked I figured. That would be a good opportunity to add this in but yeah it gets. You know, once you go beyond Mac OS, it gets exponentially complicated because you've got to then look at you know. Different Linux distros, which use different, browsers and I know the command to add this into Mac OS, it's pretty simple, but beyond that it gets ugly fast.

A

So probably it's not a big deal. How how big problem is having actually as a warden in the browser? Maybe we just can ignore it and say that's it's expected behavior. If it's it's problem to figure this one I.

B

Think it can be expected behavior, because wouldn't any local environment have this problem. Unless people went to the extent of generating a signed certificate.

A

Okay, we assume this is valid valid issue and we have to fix it. Correct I.

B

Don't know I I, don't think we have to fix this issue.

A

A

I see something from that: bastard.

A

Okay, so I don't know, we can probably close this if we will have any more complaints, because this was an internal internal issue, so nobody really complained about that. So probably we can close as US won't fix yahoo. Do you haven't listened? Maybe.

A

Okay, then I'm close as a stick. It looks like like really nobody really cared about it. So if somebody don't have any strong opinion, please feel free to open them. You can take care, but.

A

A

Look far okay, this is this is I would assume it will be an interesting topic because we removed support. We remove the fire on the cloud, but eventually some people would like to have that fire. So I would say this is polyed request.

A

So I think this is pretty good. I will just move it to ready for development and any reactions to this.

A

G

The Southside certificate issue, oh yeah, so when I do development with sites local sites, HTTP I do have a self signed certificate, but I have a self signed master certificate that I install on. In my case, I use, Windows I have a VMware I, do my doctor development and then I have Windows, where I actually have my browser. So I have this all site master certificate installed in Windows, and so any any certificate you know made from that master one will validate as as fine.

G

So then in my VM, I create ones based on that master certificate. So maybe if there was some way to either import a master certificate into cloud docker which the out which the self-signed certificates were generally a change from or some way to link that to where I can just have that one certificate installed manually and then have them automatically change from that. Maybe that would be good, because I've had a lot of success with that and it validates just fine I.

F

Would be a little cautious about that just because if we distribute a single master certificate, that means that Oh, it creates yeah the ability for anybody to sign a domain and then suddenly you know yeah no.

G

I would definitely not recommend that at all I just met I just meant like I I generated one on my own. No one else happened.

D

G

One else knows what it is, so if I can tell doctor to use that, and that would be great right, I'm.

D

Not I'm not saying that darker would.

G

You always use the same. One darker would use whatever one that I choose so I would have to make it I.

F

Would have to choose.

G

F

G

Something that would be useful to me personally, at least.

A

Yeah- but this is specific for me in those and also I- did with the card to be very different for Linux and for mark so I think it.

G

Would the command it's yeah now I think it would apply to Linux and Mac as well, but yeah I can I can do more of that or if you guys, wanna skip it for now, it's fine to just not give my two cents all right.

A

Are you okay, fabulous times this ticket to you and you can.

G

Yeah you can go inside, that's fine.

A

Yeah, so this is ticket number four or five, so honestly looks like we're done with our below, so that was pretty good. We have 10 issues for ready to pick out question. So if you, if you have any question, please no otherwise I think we have a good today and small reminder that we have weekly demos. So if you guys have anything to show you, we will be very happy to help you and assist you and thank you for what Cronan.

B

Thanks so like.

A

G