Layer5 Meshery Development, 30 Sep 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Meshery Development Meeting (Sept 30th, 2020)

Description

A demo of @smi_spec conformance improvements by @DhruvPatel0008.

A

All right uh welcome everybody. It's four minutes in, let's start, let me just share my screen.

A

Oh great chris, do you want to go first? I think you um the way to leave early.

B

uh Yep am I audible.

A

B

So the nighthawk demo has been postponed, for I guess three weeks now, so I guess now. We are ready to have final to have a look at how nighthawk is provisioned in mystery and how the results are. Looking in the ford I o format. So can I share my screen sure: go ahead.

C

By the way, uh welcome to the call everybody um it's the mastery development call and so um kush. If do you want to give a little bit of a background as to what the heck nighthawk is.

B

Sure so it will be better when I will share my screen to give a little background too.

B

Okay, so nighthawk is in their seven performance benchmarking tool, which is maintained by envoy community. We wanted to leverage nighthawk because of its accuracy, its preciseness in the test results, and the most important factor is that it soon is going soon. It is going to support, distributed load generation and benchmarking.

B

So as we distributed services running everywhere in production so distributed load, benchmarking gives us accurate results as well, as gives us some precise analysis of how our services are working in various type of loads.

B

So, to give a little background about, nighthawk nighthawk is written in c plus plus, and it was one of the google summer of code project floated under cncf foundation. So we wanted to leverage nighthawk. It's mystery, which you all know is this most mostly written in google and in javascript.

B

So this was the library which has been created to leverage nighthawk right now. Nighthawk has been deployed as a separate container, which soon we will find a workaround for this. So let's jump into the demo.

B

Yep, so here it is, my screen is visible.

A

B

So we have got a pretty high talk option over here and so, let's just fill in the fields my talk demo um right now it only accepts http and https url and in future we are going to privilege provision a grpc server for nighthawk so that we can get more variety of service to get in the load, testing github.com.

B

Let them be intact and run the test.

B

So the test has started and if you will see the logs over here.

B

So here you can see that what are the arguments given and here is the load generator so from the library? It also sees that what are the arguments given right now? We are using photio format, since you know that we already have photo ui visualizer, integrating the mystery.

B

So, yes, I guess the let's just come.

B

It will take some time because, right now, machinery is now querying the node yep yep. So here's the test result which has been run using nighthawk load.

C

C

Oh hey, chris, are you still there? We don't have you on audio, oh yep,.

D

Oh okay, good deal.

B

Is it now the time for questions?

B

So let me just show one more thing like we have, as you all might be. Knowing we have performance preferences so over here, you can now also specify nighthawk as your default load generator. So you won't need to bother about selecting nighthawk here over and over.

B

So that's pretty much. It.

D

A

Great, uh does anybody have any questions.

A

C

I have critical feedback, you know. Does anybody have can any so um as we go through this um I'll? Have some questions that, hopefully everyone else does as well, something that I would encourage everyone on. The call to do is um well I'll say it like that is to give some give some feedback um the more critical, maybe the better. um Hopefully, anyone who's demonstrating is um encouraging of critical feedback, and by critical I don't necessarily mean negative. I mean um thoughtful and um critical in the sense that you're.

C

Being constructive so if anyone's participated on uh scrum calls uh in the packing in the past, where, wherever you might have been, or maybe even more than a scrum call more like a um an iteration demo like a sprint demo, it's kind of what happens. That's kind of what's happening here as cush and as others go to demonstrate the functionality that they've been working toward. Is that it's a you know a lot of times some of the times these are like half baked works in progress some of the times.

C

These are final drafts, irrespective um even if it's a totally it's, not a draft, it's fully functioning and done and merged. um There's. You know two other there's a couple of reasons why people present for in here it's one to help and help is one to request feedback two to show off the good works, three to educate the rest of us, um keep us all on the same page.

C

So for that first part feedback. Think about it. I'm gonna because cush has thick skin and I know he does and- and I know that he he'll feel a lot better.

C

If he gets some questions and some feedback, then he will none and that just goes for anyone.

C

I encourage you to pick out one thing here that you think either can be improved or um that you really like you know either the two of those or both kush.

C

For my part, I'm curious about, if I don't know how much time you've been able to spend sort of looking at the test results themselves, um but you know understanding that each of these three load generators will um do their statistical analysis, look slightly differently, um there's I'll I'll, say: there's a dramatic difference between the way that um the analysis is charted and presented between fortio and wrk2.

C

It's a dramatic difference. You can see. Wrk2 will have this stepwise cumulative um uh charting of the latency and the throughput.

C

How's it been for nighthawk.

C

B

Let me just grab a o results.

B

This might be it yep. So for the responses which are recorded over here so for ford io, we get a p99, I guess, and for nighthawk in the stepwise graph we basically get more of the ps like if you will see on the graph p, 76 p, 87, p 54, like some more details, are recorded over there.

B

So nighthawk test is basically more destructive, more descriptive than the fort iowa, but since in the results we have only leveraged the showing of these five standard fields so, like you, will actually not see the accuracy of the complete nighthawk, which gives like complete accuracy, which nighthook gives, with the test results.

C

Did you have a list of it'd be okay, yeah, that's an interesting thing: do we yeah? How do we so right now we're not showing the wait? Wait. Let me, let me make sure I'm capturing this correctly. It's is, does nighthawk produce more percentile uh results, yup so like over here.

B

There are several question ties which are actually not yet captured in our details or if you will just see the smi logs are messed up.

B

Let me just run another test, so you will be able to see the test results which is generated by nighthawk and which is raw and not converted into fort io.

E

Format, I should do.

B

Yep so over here, this is the original version of test results which nighthawk gives and, if you'll see the results which photograph. So it is more detailed and more descriptive than what fort io has been leveraging in mystery for us.

C

To expose that info, how disruptive is that to like right now, the chart that's produced? It's the same chart um same uh it's, um it's the same chart that's produced for fort fortio and wrk2 um we're storing the performance test results in the same. I assume in this are in the same database format or we.

B

um If the format is same, the only difference is that there are more percentiles recorded for nighthawk, but since both of the results are fully complete uh compatible so forth, I was able to four times.

C

Sorry so it can plot the graph. Are we persisting the additional percentiles or going with kind of a lowest common denominator.

B

I guess I'm not able to hear. Let me stop this screenshot.

C

Of those additional statistics, can you hear me hello.

A

C

A

C

Kush, you are audible, which means, if you can't hear me you're not hearing me say that.

C

How about now kush was your.

A

F

A

Rejoining the meeting.

C

So who else has feedback for kush, even though you can't hear it? Who else has questions the feedback.

B

Am I audible, yep? Okay, I don't know what was the issue, because my benefit is quite better right now, okay, so let me just share my screen again.

B

Though the last question, which I remember that, if we you were asking that, how can we expose the descriptiveness which nighthawk gives us, am I right.

C

Yeah or uh yeah- and I don't that's not necessarily to suggest that we have to it- might be the case that uh yeah I mean it would be. It would be nice um at some point. We're gonna have to diverge from the total, the total uniformity and consistency that we have right now, as we consider that we'll have multiple instances, nighthawk running it's so.

B

What I thought about that was, since we are giving out the results in the canonical sm smt smps format, so we can leverage the descriptiveness which nighthawk gives us while we download the results from over here so in the yaml file, which is downloaded by nighthawk, so we can basically give them all the details which nighthawk has captured so like. If you will see here, we have only recorded file, it is five percentiles which are listed here by default, so we can make changes over here.

B

What's your suggestion.

C

C

One I'll note for everyone on the call that that's an open area of work for anyone who's go lang, capable that we're capturing a bunch of statistics, but when someone goes to download those we're only giving them so many in the service mesh performance format, the smp format.

C

um I guess your question probably answers one of my other questions, which was an acknowledgement that, while we're not visualizing all of the results um right now that we are, it sounds like we are persisting. The full details of nighthawk results.

C

Yep, oh wait! I missed that and that's it. You said yes, okay, great, then yeah. I told that because.

B

Let me just give you another example over here, so this was a test which I ran, which I run just right now so over here you can see. P80 has been captured.

B

So if I will just grab the latest test, you can see there are six. They are six percentiles 50 75 80 95.99.

B

So I don't know, what's the issue over here, that if the ui is unable to leverage all the percentiles over here or is it something with the golang server or the handler? But it is quite, it is quite um irregular like here you can see only five and that's the one. The the following discrepancy is only in the case of night talk like for fort io. You have five well-defined.

C

Percentiles yeah, it does seem like something that we would want to work toward that. um Certainly the spec itself yeah. As we look at the protos there it you know, I would think that it should certainly be extensible to allow people to define different percentiles to be more granular if they so choose that that doesn't that that doesn't hurt anything in in so much as the implementation that we have inside of mesherie yeah. It would seem like um in time we would want to work toward um exposing all of that granularity.

C

You know first capturing it in the data store and also you know, exposing it.

C

It doesn't seem harmful like when you think when you think about.

C

You think about making database queries over the data if it's, if it's in the same format, irrespective of which load generator is used, but one of the result sets one of those has greater depth of detail. It's the same descriptors, the same json descriptors, um but one of them has a few more percentiles that shouldn't mess up database, queries and things like that so yeah. I would think that we would want to try to expose the additional detail when it's available.

C

What's a little more um thought-provoking is and and for everyone on the call, I don't know if you realize this, but part of the reason I mean one there's a couple of reasons why nighthawk support is being added. I think for some of you. If I was sitting there watching this, I would be thinking.

C

I would be asking the question sort of thinking. I'm not really sure why we need a third load generator like aren't they all just sort of producing more hdp traffic and you're only running one at a time. So, what's the what's the need for yet another one?

C

Aren't there isn't there more important things to work on at least that's what I would be thinking, and so the the point of the biggest point of why support for nightmark is being incorporated is to go after the goal that isn't that we haven't done that we collectively haven't done yet, and that goal is to not just run an instance of a single load generator, but it's to run multiple instances and that actually, I think, as we engage with the envoy team, um there could be a lot of work there or there will be some work there and it depends on whether or not they're they're carrying the burden of coalescing result.

C

You know statistical analysis from each of the individual nighthawk instances or not if they are good, there's less work for for mashri to do, but either way we think about it. Kush. Let's say that there were three nighthawks running: um um the users are going to want to look at results, statistical analysis from four perspectives in that case, look at it from a perspective of each of the individual load. Generators that we're running each of the three and then also look at the fourth overall sort of coalesced results.

C

So some what I guess, what I'm alluding to is at some point we're going to have to break into the charting library that we're using here anyway, which I actually, which brings up a good point. I think we're using two charting libraries in mashari right now. One is, I think, the one that we're looking at here is chart.js if memory serves and the other ones that we use for graphing out, prometheus and grafana charts is billboard.js.

B

For the comparison two we are using, billboards is.

C

Anybody else have feedback comments or.

C

C

I was waiting for someone to maybe point out that kush if you go to the performance page, to create a new test that it might be nice if nighthawk was if all three of these were on the same horizontal row. Oh.

B

Yep so like basically, the ui needs to be a little more descriptive because right now, if you will see that wrk2 and italk are provisioned as separate containers so like it will be better. If we have a nice tooltip over here, which would describe all the load, generators and the way to run them. So like yep, that's a pending section.

C

All right, I'm taking notes good yeah, keep going so a tool to an explanatory tool tip, maybe that talks about uh running this container versus running as a library.

C

The at some point too. I think a common question that people are going to have- and this is going to you know a common question people have is. Why should I choose one versus the next um and, moreover, how would I interpret these results differently? If I do run one versus the next?

C

This is going to bring us to a point where you know we have some of that in documentation in the mastery docs, but it's nice when or at least I consider it's nice when you're using a piece of software, and it has well first of all, it's nice when you're using a piece of software and it doesn't require docs like you really that's that's the goal is to not have to ever.

C

Have people go there, but when there is something fairly technical like this and there's a greater explanation needed that if the docs can be in line meaning accessible right here in the ui without having to be redirected somewhere else.

C

This is something we should give a bit of consideration to, because I think, for the most part, it's explanatory tool tips that's about as far as we go, but you think about the when you hover over a load generator, if it it. Maybe there's a motor like for inline docks a model.

B

Like if that that can be one of the intended behavior like if I hover on port o, then it should give me some some special points about the four tie. Only for wrk2 and same for nighthawk.

C

Nice uh so uh so pratier was providing some additional feedback, uh suggesting that perhaps perhaps there's some ui changes that can be done here, not necessarily specific to nighthawk, but in general, on the performance test page and pratt.

C

I'm excited to think that you might focus on this page because you're right um there's a lot of thought that can be done.

C

I'm excited that you might focus on it because of the good work that I've seen you.

A

Do oh yeah, this is made with react.

A

All right, um if nobody else has any questions for kush, we can move on.

A

Just let me share my screen.

A

All right, um one of the articles in the agenda today is that lay five is participating in half double fest, we'll be adding a program card by today. There's a pr open for it. If anybody wants to go, have a look, adding suggestions that you want to.

A

For those of you who don't know how to the fest is a get to know, git event that happens throughout the month of october, and you get um some swag for completing about four peers in any active and live organization that is registered for the event.

A

I'm bringing this up, because um if anybody has any ideas for possible issues that can be created across the mastery or the s, snp, repos or any of the adapter repos now would be a pretty good time to bring it up because it starts tomorrow and those issues can be created.

A

um I'll add a link to a google doc here you can go ahead and add your ideas now or anything that you need well anything that you need done or that can be passed on to an issue that any contributor may pick up.

A

uh Any issue that you create for hector perfect must include the hacked wfs label on github, which is being added to all the repositories under layer 5., and that's it.

A

Please do suggest any issues that you want to. uh This is a pretty good way of getting word out.

A

Anybody has any suggestions or anything to add to that.

C

There was a question about whether or not the the tweet had gone out saying that layer five is participating in oktoberfest, so.

A

It hasn't because the program card hasn't been merged, yet uh it will get it.

C

A

Yeah, it will go out by today. Okay, definitely all right, any other feedback.

G

Hey would add in tags of the of the programming language which you are going to use would attract more people.

A

uh Possibly yes, that's uh because.

G

Basically, people are going to google search right they're, not coming and say I'm gonna look over here.

A

That's a good idea.

A

All right, any other suggestions.

A

A

All right uh moving on through, we can go ahead with yours.

B

G

Yeah, so this is a very small change, but I'm sure he's gonna take this time to tell what he wants confidence to be the basically. I shifted the smi test results into a new navigation library and currently the conference navigation bar and the smi. The results bar lead to the same sms. We have not decided what we want to have in the conformity space for now at least.

G

This is just some old labor. Well, it does not been updated so.

G

Yeah this is it.

C

Oh nice, it drew um questions and feedback. Then do we. I wonder if we might be able to be rid of that. First faucet, that first air.

G

C

G

Yes, let me look into it. It's just basically to expand all of the options which you have it's like. Oh, I see.

C

Yeah sure I didn't understand that yeah that, like.

G

Like right now, I only have a one whistle right. If you have more than one, then it will expand all of.

C

Very good, it might make sense that we're color, colorizing or distinguishing the column headers slightly differently than the rest of the rows to different.

G

Yeah, I can make them bolder.

C

When you go back to the perform, the performance test results like ideally the the um yeah. Ideally, these two pages are really identical, so the missing checkbox is probably why I didn't realize that that faucet was for expanding and collapsing the entire rose.

C

This one doesn't have bolding here. Okay, that's interesting! I I yeah this one doesn't have bolding, so maybe we wouldn't, um we should be consistent. Consistency is really important.

C

Speaking of the table that we have in the smi results, it has a shadow to it. The the second table. I wonder, um yeah what it would look like.

G

Well, this was intended because without the shadow, it wasn't really making a distinction and adding a outline itself wasn't really connecting with the ui itself. I tried the outline part because yeah all we are using pages everywhere with shadows. That's it.

C

Gotcha, when you go to the performance test results- and we do a quick um comparison, so you might have to run a quick performance test. Oh wait. One second.

D

Let me log in with my account in one minute.

G

But then we won't be able to compare the sms results right because.

G

C

Oh sorry, okay, so yeah. So here um it is, there's no there's, no shadow. It's just a an additional set of data.

C

um Some like the challenge that we're having the reason why a drop shadow was used on the smi results was because it sounded like what you're saying is without it. There we have it's like really hard to offset the table and table effect.

G

Okay, if you want a different ui, then what we can do is similar to this. Instead of having a paper itself, we can have different sections assigned right.

C

uh Yeah, if it does hopefully I I could see that maybe it wouldn't work or something but but like. Hopefully we would try to make it the same and then, but if it's not working, I understand if we need to deviate.

C

So this one right now, this one has the ellipsis, on the right hand, side to get a get a modal with like uh to so so that here that we're getting a visualization and if the user wants to get the tabular format for that visualization, they yeah they click on the ellipse and um which I think is a an issue that continues to plague us in some areas, um but they they normally get the modal. That kush was demonstrating earlier, like one like this.

C

So if we just just refreshing on the user interaction here, if we go back and look at the smi results,.

G

We won't have a detailed space right now. I can add that.

C

Well, I don't know it's just sort of an open question like is, that is that necessary? Maybe we don't if all the details are already there um in your other example,.

G

um Well, I need to oh, I won't.

F

Be able to see.

G

It right now, because I'm not logged in to look because we actually use it right.

C

Gotcha um but yeah anyway, I guess that's sort of just maybe the biggest general feedback there is um to the extent. Today we can reuse and provide a consistent experience. We would want to start from there and deviate, if necessary, hopefully not necessary, but deviate if needed.

G

Sure what I can do is I can show you some different formats. If you like of that table itself, I guess the detail thing can be implemented should be implemented. I will definitely do that, I'm not sure about. If you want to change the ui which I decided for xmi but yeah, I can show you some more instances.

C

Nice uh josh and fonzie had a couple of comments as well.

B

A

Yeah, if you want to speak up, please go ahead um fongie. I don't think your uh audio situation is that good.

G

Like josh is saying, can you tell what the top right most icon represents in conformance page uh this one? Well, it's not representing anything right now, but we have.

A

I think he means the um right most one in the top number. Oh I'm so sorry my accent is setting set up.

G

Yeah this one, this is basically a filter which we can define right now.

E

So like, as I saw, it was not present in the results page so like just. I just asked for out of curiosity yeah.

G

Yeah, I don't have any.

E

Much much knowledge about it, so just.

G

The the mui table, which we are using of certain things, which you have disabled right now, like downloading the data printing, the data searching for specific things and like choosing which columns which you want to have right. We have just enabled searching in columns for results and for sms. I also added filters.

E

G

It's a inbuilt function.

G

And another one: can we have a collapse all show when we have more than one items just my thoughts, oh yeah, I I guess this this button over here was the answer to that question. If I'm not wrong, it will collapse, also show all the results right.

C

Yeah or I think um what funji was saying, um maybe we wouldn't have the collapse all show hide all if there's only if there are zero or one results, but only when there's like two or more.

G

Over yeah a little bit- it's okay yeah! We can do that. It's fine reading for now yeah. I guess we need to implement that on the performance results page itself too,.

C

G

D

C

The yeah, actually the smi test results table has um or at one point had had some pretty cool options. I think some options that you wouldn't find on the performance test table yeah, I disabled them.

G

Okay, because I didn't see them used over here so like.

C

But to your point like it might be the case that those are nice things to have. I think one of them was like the ability to print the page or like turn it into export it in a. I don't know if it was exporting a png, but but.

G

Not the png or json file, I guess json or the amazon. I don't remember, but something like that.

C

Those might be nice to haves on the other. The performance test results like it might be.

G

Yeah sure, but the problem over there would be right now, if you click on that, it will just give you the results which is shown over here. It won't give you the details results to which we are looking to get basically the this results. It won't give you that gun out of the box. We need to customize it to give those. It will right now only give the results which are viewable by the.

C

Yeah, there's a there's a few improv I mean yeah. Actually, as we look at the performance test, results table, there's probably a few improvements. Some one thing, that's not obvious to everyone, including myself, is um it takes the user check, marking the box for a given result in order for two things to show up, so one thing that will show up is yeah in the upper right hand corner. This is a really neat feature the ability to compare two tests uh together so yeah, if you click it it'll give um well.

C

This is maybe not the best example. I guess, but but it'll it'll overlay, two charts on top of each other, so you can visually difference between on the result. Sets which is, I think, is really neat. It's like. Oh, if you made a change in your environment now you can see what the performance difference is, um but so that's good. It's not always the most intuitive thing like people. It takes people check marking the other thing that also how.

G

Do you want to implement it in smitable results? Oh yep.

C

C

C

The tabular format like.

G

Export hello, I can't hear you for some reason. uh I can't either actually.

A

Early, you still with us.

A

I think there's.

C

I guess it was just beating his back.

C

If you check mark just one of the record sets on the performance test results table, it should it'll also give you an option to download the results so.

C

Yeah, I think, for some of those all of us on the call.

C

There's some things for everyone, maybe to think about here about whether or not so, if you just check mark one of them yeah, then you get that download yeah, and um I don't know that that feels kind of buried kind of you know hidden it to me. Anyway.

C

It takes a little bit of use for people to figure out that. Excuse me that all that functionality is there. I don't know that I have any good suggestions. I'm just kind of talking about it out loud.

G

The thing which we had before in the conference, so I just reserved a special icon right over here to download stuff, but even in that case, if nothing is selected, you will download all of the things and if some something is selected, it is anyways giving us the option. Okay, it is only giving us option for one of the downloads.

C

I think one way to help with discovery for users to understand that there is functionality here is to potentially show the download icon just in a disabled state up until the point that someone check marks a row and then enable that state could be the same thing for the comparison as well, which I, which again, like I I'll, say it again like. I think that that's a really cool feature, but isn't always people don't always know it's there.

G

Yeah, we need to look into it because this icons over here these are like the default things which uh mui table which we are using provides. So I I think there would be a workaround, but we need to look into that.

D

That'll be in terms of yeah, okay,.

C

Right right: okay, any other food, other feedback for.

C

Truth, I'm true, if you can, can you go, but can you show the the smi conformance table.

C

So, for everyone's context, uh the when you're interpreting these results, what the user has done has gone. They've gone over to a specific service, mesh they've um told mesri to run a set of tests. um There's there will probably be 25 35 tests, individual tests. That will be run where the a given mesh will be.

C

Can you know confirmed as being conformant to the specification or not the id column, that we are the value that we have inside that test id? um It's not like. Any users are giving a name to the test, they're, just invoking it, and every test will have a unique identifier.

C

um It might make sense to do that. We um squash that a little bit or sort of make it yeah.

G

There are a few few things to be done. The id needs to be shortened. The time needs to be formatted correctly. I was thinking this could be good oktoberfest, like small beers, sure.

C

F

C

Of the leftmost column yeah, if the id is shortened up- or you know, truncated or curtailed, yeah the- I guess I don't know when people come and search- it's probably the date that they're most uh that's like the primary key for them, so to speak, and second to that is probably the type of service mesh. So um all of these fields, all these columns are sortable or no.

G

uh They are sortable from the back end. They are filterable from the client side from the ui. You can filter out the columns you want to see, but you can't like change the way they are sorted. You can do it in the in the code itself.

G

C

Do you know um is the filter that we're using I'm sorry the sort that we're using on the back end? Is that just an ascending date, or is that by date,.

G

I'm not sure, but currently I need to look into it. I'm not like. I don't remember it right now,.

C

But what do you want it to be? uh Yeah, probably the default would just be yeah like uh latest at the top last last round,.

C

Interesting yeah, if um so this is, we were talking a little bit earlier about the notion that there's um we can begin to bring in some in-line documentation um on the demonstration that kush was giving.

C

This is probably another example where there's a little more info that people are going to want that are generally going to want to understand, and it's like it's one of the questions that people are going to have is when they see a test result, fail they're going to yeah they're going to want to know the reason for sure and the reason could be right. Now it's not found it's a very short reason.

C

This crd, this crd, is not found and it could be longer so we'll want to have a plan for um how to control that length and and yet still give people full details.

G

Redirecting them to the documents which would finally make would be something good.

C

That makes total sense for the question of like what is this test and what is being tested. That makes a lot of sense. It might be again like if we do it in line, it might be a modal where um that documentation is relatively static and we can, but for the second question which is like okay, I understand what this test is, but why did it fail in this case?

C

That might be a little more dynamic in terms of its length, so the reason column might be more dynamic.

C

Any do how do we handle that.

D

C

G

Just to the extent immediate thing would be a proper break to give on more details, but uh I guess in long term a multi-line box would like me force it out. I don't know.

C

Yeah, it could be like that. You know that ellipse on the other, it could be a way of um when someone a tool tip would be kind of a poor man's solution. A multi-line row is probably hard to read after a while, because it could go on for many many rows and it's kind of, but that ellipse or something for additional details with a modal that gives kind of all. You know everything else might be helpful.

G

Yeah, okay, what do you mean by ellipse? I I didn't get your point.

C

Yeah- and I don't know if everybody else calls it that or not, but you know the the dot dot dot on the right hand, side of the.

G

G

And when you click it, it gives the whole string or like a pop-up concept.

C

Probably a pop-up like you could there could be a tool tip that gives the whole string and that might suffice, um but then yeah the um a modal like a pop-up, and it could be that if um that modal could do two things, it could do what you were saying about answering the question of like what is this test and what's being tested or.

F

Like in sharepoint it's it's like, it drops down a list, save it or share it or print it, but and they call that an ellipse when it's a dot dot, just another way of a carrot. In my opinion,.

C

And uh yeah, and by the way, speaking of uh nomenclature, uh does everybody else call they? You know kind of refer to the menu as a hamburger that the three the three stacked anyway, as we're all getting onto the same anyway uh pratik. It also had some other another. He was just saying: hey, you know an faq on the left. Menu for tests that are failing a pop-up might block the result below the current results. When we're comparing two results.

G

So how would you compare two results if you're gonna trumpet the values, it's like shrink, the values itself from the details itself.

C

I think I think in this case we people- probably I don't know that we're trying to facilitate that use case about comparison here, so that might we might be okay. There.

C

Any do we have any other feedback for drew any other topics to discuss.

C

Should we bring bring us home nice nice work, don't know.

A

uh Thank you. That was a pretty. That was a very good demo.

A

I'm looking forward to um thank you, so uh much is afk for the moment, he'll be giving us his tutorial next week or hopefully in the community meeting. uh That's it for today. Folks, thank you for joining us. Thank you for coming on. Thank you for everybody, for the tutorials kush and drove see you next week.

C

Thanks dhruv, hey sweetie.

A

D

D

D