GitLab Digital Experience, 14 Sep 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: LaunchDarkly: A/B Testing in Buyer Experience

Description

Come follow Miracle and Javi as they set up LaunchDarkly inside the Buyer Experience Repo

A

All right we're trying to push and a B test with navigation, and so this is the first time doing it. So you should run a short little video talking about what we're doing here so share. My screen should see this uh so pretty much.

A

What we're doing is Miracle made an MR to test something in navigation and then name this feature flag, and so then what I have to do is go in from the interface and then make a feature flag here on this end and right now, I have it turned off, but right now, I have when it's targeting turn off.

A

It's going to show the experiment and right now we're just going to walk through like toggling that manually and see like the differences between the two and then I'll turn it on, and then we can move on with the Mr. After that. How does that sound? I think it sounds good. All right go ahead. Miracle.

B

uh So to test out this new navigation, what I did was I created um two components in the nav repo um that you see here: navigation, uh just slip, navigation slip, navigation, B um and then generated a new npm package for this navigation and then imported it into buyer experience um and then wrap them in a launch Darkly tag so that when hobby turns the feature flag on we'll be able to see the differences between the two navigations. So.

A

B

Now we're looking at um navigation B with the register button down here in the support drop down and.

A

Then yes, I'm about to change it right now, so to change to false uh and you're. Just gonna have to take my word for it that I'm changing it, and so now, if you refresh it, you should see the different variation.

B

Yeah register should be here.

A

Let me see, let me try again targeting is off register false, wait. What okay try again.

A

Oh, what I'm sorry we were just like it was just working a second ago. Wait hold up. uh Let me try turning it on give me one. Second, I'm gonna do like the thing, but manual way, so it should be false, so targeting on Sir false comment, uh turn on with boss production, okay, let's try again.

A

That's awesome: wait! Wasn't it just working a second ago. It definitely was hi we're back um able to figure out what the issue was. So as it turned out as I refactored, the launch Darkly component to support multiple tests. I forgot that I have to change the values from booleans to numbers in the feature flag. So I did that here and just to show that it's working if I change this to experiment, I save this here change value to experiment, change this to production.

A

Do that refresh the page. We should see the different Navigation, so this is working now. So what I'm going to do now is a couple things actually I'm going to do change this to a percentage rollout. So if I do this to 50, 50 I, believe that should just work now. So let me sort of change to I'm just going to roll out 50 50.. If I hit this to production, this should now be serving different ones.

A

Now it's just a matter of approving the Mr and seeing seeing it work we might want to test it. I might want to test it like in the in the review process a little more thoroughly like just before we put the submer the.

A

What is it the merge button I forgot what that button was called Hit the merge button and like actually push it to production, just to see that everything's working as it should but I think that should be it I think we can close that out. I can just go through it one more time after this call and then approve it and then merge it in so I think that was it. That's.

B

Good thanks for the help yeah.

A