GitLab Quality Department, 24 Mar 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: End to End Test Pipeline Failure Debugging using Pry

Description

End to End Test Pipeline Failure Debugging using Pry

Intended as an extension of existing videos:

Quality Team: Failure Triage Training - Part 1
https://www.youtube.com/watch?v=Fx1DeWoTG4M&list=PL05JrBw4t0KpZUzlEnvlvBtf_NwShU_ot&index=18 (36 min)

Quality Team: Failure Triage Training - Part 2
https://www.youtube.com/watch?v=WeQb8GEw6PM&list=PL05JrBw4t0KpZUzlEnvlvBtf_NwShU_ot&index=17 (34 min)

A

Hi and welcome to this session on test figure, debugging.

A

I'm not going to duplicate, what's already been covered off in the existing very useful pipeline, triage videos, um I would recommend them. They are worth a watch, a lot of brilliant info. um What I'm going to focus on in this video is something that was touch upon in the previous video about using pry as a as a testy bug too.

A

One thing that I want to mention was the entry point idea I found out about failures, um either from slack reports uh test case issues, the most usual being being tagged in a bug issue which was used by the engineer who investigated the door was on triage, or I can't investigate the latest pipeline trails report. Myself um has been mentioned. If you watch the pipeline trade videos that were referenced earlier, there are several slot channels reporting from different pipelines.

A

A few of them now have granularity to give some visibility, and so, while they're, not as the secure tesla's field as a part of this example, this isn't fairly recent. So don't worry.

A

Reproducing issue always useful I'll touch upon rolling up the tests locally in the previous video. The pipeline trades video was referenced earlier- also go into this, but what it will say is that if it isn't reproducible locally, we can use the container from the pipeline and the instructions are on that link again some excellent reference documentation. There.

A

um I use pry as my main debug 2 ruby folks, probably familiar with this offers. Debug tooling can also act as a bit of a interactive, ruby terminal.

A

um Here's something I used in a recent test where I was on an intel test. The selector wasn't visible and in a second I'm going to go for a walkthrough um which will be very similar to this.

A

A

I had an issue: um let's try and reproduce it.

A

So it's a slightly contrived example, um but it is based on a true story, um an issue that did occur recently.

A

um So for the purposes of brevity, you join me at the point where I've been alerted to the issue and I'm trying to run up the test reproduce it. um So, let's see, kicked off the test. um I'll turn up a bit of.

A

A

A

A

A

So the test itself, um which is where the border pit the startup for um create access token crypto runner, create the project populate. The project move through the pipeline make sure that the pipeline.

A

A

So you can see, on the left hand, side of the screen can't deny licenses.

A

A

Unapproved licenses filled.

A

So where have they failed unable to find css data? Qd selector, blacklisted, license radio, um similarly dot qa selector approved license radio.

A

So it'll do this over so a couple of uh breakpoints um so when, within the license, compliance spec, um the blacklisted test was line 65 and 53 for improved.

A

So let's see 165 just before it.

A

On binding, which is the breakpoint again, it was line 53, so just before that.

A

And I also want to set a breakpoint at the function, usually afterwards, so license compliance I'll be 49. Under my.

A

License compliance, which is our um test functions um it's important so so, just before the click element, um probably a useful place.

A

Approve lessons.

A

There just kick off the test.

A

A

Policy tests right so here's your first breakpoint, um so this is on the actual spec test itself, so it's column approved license. um So, let's step into that.

A

um Just right into our test, so click element license out button. Yep expand place, search for the license, go to contrast. If you want to see what license it was searching for mighty lessons, so next on that and selected the mit license. So um this takes us to our next breakpoint, which was on the click element of the approved, license radio. So I've been stepping forward next. If I try to run that up outside of the test, it happens.

A

So I'll just make this a little better, so yeah I've got the same issue and it will find css. So let's try and find the.

A

A

Okay, I see him simulator called my copy bar. It's not visible, um approved license radio. So that's how we look in our browser visit, not in the source code. Perhaps I'll move my face out of the way.

A

uh There we are, there.

A

Dot, q, a selector approved license radio. So what is there so.

A

Let's see, let's grab all of our selectors all of our uh dollar q, a selector selectors so patched at.

A

Okay, subscribe.

A

A

Some content, drop-downs buttons links content, no, no radio here, so it's in the page it hasn't been found here. Now, let's go back to your message, unable to find visible css.

A

No, it's not a clue! So, let's go back to where I grabbed all the selectors.

A

Let's allow for visible false I'll, just grab a lot more selectors this time. So let's do the same. Selectors to select or put us the selector.

A

Scroll up, oh free, license, radio. So suddenly, when I, when I lie for the non-visibles, it's it's there, so as it turned out, um this was a bit of a known issue.

A

So it's captured in this it's still open. As of march 2021, um the proposal is to use um choose element from radio buttons, um so what I have done is, I have made up a bit of a choose element function um within the uh qabs. um It's a little bit hacky at the moment, but um it allows for finding elements where visible is false.

A

um The native click perform. um So, let's see.

A

I'll bring our automated window up as well, so closely inspect this one.

A

Okay, so, rather than click element, if I use that little uh choose element function, approved radio license private license. Radio, sir.

A

That has been clicked so.

A

Let's exit out of our price session.

A

Okay, so let's go back to my cold: let's license the plants back I'll, remove the brick pots.

A

License to plants.

A

Points for the license, radio buttons I'll change these to be not. You um choose element.

A

Okay and then I will kick off the test.

A

A

Personal access token, in the background we've written a runner so gotta test that.

A

A

Has clicked the radio button.

A

To the approved test you can see, in the left hand wondered already proof test has failed. This has passed so the proof test has passed.

A

The next test, yep that is denied onto the night test, has passed. Okay, so um thank you for watching.