GitLab Analyze:Product Analytics Team Meetings, 28 Feb 2023

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Production Funnel Analysis Demo

Description

Max (Senior BE Engineer, Analyze:Product Analytics) shows a working real-world example of funnel analysis.

A

uh Hey there folks, my name is Maxwell from a senior back end engineer on the analyze product analytics group and I want to show us I want to show the funnel analysis um work that we've been working on for the past few weeks, which is now in production and available, um although behind a feature flag.

A

uh So there's a few a few parts to this. First of which is, you can now Define your own funnels, which is awesome so in the product analytics Dot, gitlab folder. You can now create a funnels, folder and Define as many as you want, and one per file so on this project, I've defined a funnel called activities, and it just tells me how many people enter this particular website through the home page and then move on to the activities page. It's a really small funnel. But hopefully it illustrates the point nicely.

A

So this file was committed to the project via an MR if there are any compliance requirements or code owner rules or anything like that, the file is is um checked in the same way that any other file in the source control would be.

A

um So that's great, and this then defines a dynamic schema in Cube, which is awesome and allows us to query it as if it were any other API. So from this we can now uh query Cube to get out the information as to how many people made it through this bummer.

A

So over here you can see the standard query, slash projects, slash product ID. This is a private project, so we'll be able to repeat this, and then we call our Cube forwarding proxy request.load, and the query should I like this, which is defined in the gitlab docs, and if you go into docs and search for product analytic, funnel analysis. You can see an example like this. If you set the name of the funnel and replace it wherever you see it here and here as well,.

A

And this should return a list of steps and counts, so we'll just refresh it.

A

Great, so, amongst all the cubecroft, you can see the important bit here, which is data um we might be able to look at it and Json might be a bit nicer. Is that better? Arguably, not okay, we're about to Json text. uh You can see that we've got two steps and in my test data set there were 563 people uh that made it through to the first step. So in this case, that's basically how many people hit the home page in the time frame, which at the moment is all time and then of those people.

A

How many made it to step one? You can see 334 of the 563..

A

um We can add as many as we want to this. uh We can edit this as we go along as well, so let's go ahead and edit the funnel and, let's add another step and see how that looks so uh we'll get this name uh we'll just find out what some of the other pages are called first, so we can see that in the behavior dashboard, hopefully, okay, so activity is a big one.

A

This is another quite well presented page in this application, so probably a good chance that uh some of them will be there so correct.

A

There it is uh so.

A

What's the name of the page, the target is that and the action is a page view.

A

Great, so you can see, rather than use that to R and off and also we'll just commit those changes, because this is my own toy project. I've got the ability to commit directly to master, um but we should now be able to query the project again: um wants cubes caches refreshed, which can sometimes take a few hours. uh You'll see an extra step here and we'll try a couple more times and see if it does appear and then I get that's fine.

A

So it's because uh the preregation only re-aggregates every few hours, which is why we can't see the Second Step again. There you go last refresh time was just now.

A

I have to give that time for it to appear I'll, try again in a few hours and hopefully the date will arrive, um but, as you can see you can you can Define these anywhere. You want to um again. If you wanted to create another funnel. You just create another file in this document. In this uh all this we've created another one called completed purchase, so we can replace activity releases with completed purchase.

A

uh I, don't think the data exists in this project, so this will probably return nothing useful yeah. You can see Zero got to the first step. uh 897 people completed the first step and no one made it past past that and if you try to pass it in the name of a funnel that is not defined, you should receive an error there. You go completed funnel, not found oh completed for the purchase not found for that path. So yeah, that's where we are right now.

A

This is available in production today, assuming that the feature flags are enabled for that particular project um feel free to reach out to anyone in the products analytics team. If you want to enable that, for a particular project and you'd like to explore more thanks very much.