GitLab Engineering Productivity Showcases, 20 Aug 2021

Previous Meeting

⏯

youtube image

►

From YouTube: Engineering Productivity: Test report overview

Description

Kyle reviews the test report functionality and how it helps for master stability and could be improved for linkability

A

Hey this is kyle weavers on the engineering productivity team. I just want to record a short video to show how useful the test report can be, but also how many clicks it can take to get some of the useful data related to master broken monitoring, but really looking at master stability in general.

A

So we are notified of master failures and slack, and this is our process. But really what I want to illustrate is how much useful information is there in the test report and again how to get to it. So this shows that there is a failure on this r spec job, I'm going to click on that to kind of get some information, and I see this spec that is new to me on a failure. I haven't recognized this one failing for a flaky reason, so I'm going to look at the test report to get more information.

A

As I go into the pipeline view, I can then look at the tests. We have 184 000 tests that run in this pipeline. So a large number that was an r-spec ee unit test. You can see here. There was three failures, so I'm going to click on that.

A

And then here's that clear, shared runner minute worker spec. If I look at the details here, I can see that it's failed 12 times the mass in the last 14 days, so this is likely a flaky failure or something that is failing very often right now.

A

So what's useful about this. Is this gives me a signal of how prevalent this error has been, and I can use that in reference to other specs that I may be looking at what is challenging is at least getting to this point in the ui there's no direct url. So if I need to reference this in an issue like say down here, I usually use a screenshot and link directly to the test report, but even just getting to this point so that someone could click few details would be immensely helpful.

A

I hope this video helped kind of illustrate the number of clicks to get information and the value that is there with the test failure feature thanks a lot.