CHAOSS Metric Models Working Group, 23 May 2023

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Metrics Models Working Group Meeting May 23, 2023

Description

Meeting Summary can be found on Discourse: https://chaoss.discourse.group/t/metrics-models-working-group-meeting-summary-may-23-2023/148

A

And transcripts Elizabeth, can you click on transcripts.

A

Captions I got it.

B

Open question and it sounds like a Robert's Rules of Order matter, yeah.

A

Well, I didn't know, it was early in the morning and I was like.

B

All right, so it's not as formal as all that good, no.

A

B

Quite ready to open with Robert's Rules of Order, oh.

A

No um so hi everybody Welcome to the chaos metrics model meeting it's good to have everybody here, I think we have quite a few things on the agenda uh for today. um So there was the this is the seemed like there were two kind of open questions and Don I'm kind of looking at you one. It looked like around the project, starter Health metric model- you had a conversation with, was it was it Luis? Was it that kind of about the metrics that are in there as well?

A

Wasn't there something there, as well as with yahui in slack.

C

uh Yes, I, but the the conversation with Luis is um specifically about how we're measuring the change closure ratio. Okay, um he had a very different idea of what he thought we meant by that and he was trying to clarify it, but what he meant by it wasn't at all what we actually meant by the metrics so I'm, just trying to clarify with.

A

C

Suspect that we all right I think that's a question for comment, maybe maybe I. Maybe we don't do that here, fair.

A

C

Longer conversation I think no.

A

Problem um thanks for that, though, and then how about the other part the one with yahui that was I! Think more specific to this.

C

Yeah and I think I think this brings up a broader question for for the chaos project as a whole, because um as far as I'm concerned, when when we that we, uh the Google Docs that we use to draft the metrics are a way of collaborating on a metric until we get it in GitHub um and then from that point.

C

um From my perspective, we should probably never ever look at those documents again.

C

um However, I know that lots of other people look at those documents, but the problem is the documents are out of date compared to what's in GitHub, because all it takes is a couple of pull requests to make a few changes to a metric and then that that word doc is out of date.

B

C

Yeah but I know people like to go back to the word doc. The next time we revise the metric and I think that's also a mistake, because the the metric could have um a different direction, even if it's even if it's just you know a matter of like a few, you know typos or errors. You know we. Those would end up creeping back in if we continue to use those those documents.

C

um So the question that yahui had was hey. I was looking at the word doc, and it still has time to close in it, um and I was like yeah that shouldn't be there, um that we should be using the one in in the on the website for the metric yeah.

B

I tried to collect it until like three years ago and lost so I. Do agree with your point.

D

Yeah, it's like. Actually, the question from me actually comes up from the compass live I I'm, looking at Matrix exits like in that model, I I, compared with the with the models existing chaos. They are slightly different. I I find one more Matrix exactly in canvas live which is not existing in the in the chaos matrix model. So I'm trying to look in bike, the Google Docs we had so I saw that made a mistake.

D

We made Implement such matrix model, so I found that when we implement this matrix model, I mean the starter project house. uh We do have that metric, but the ones we upload to the a I mean the deployed in the chaos website. This magic is, is removed, so I'm thinking um it's a collaboration between the chaos and Compass live. So once there's one any update something like this. In this case, we removed one metric from the matrix model.

D

Maybe we need to set up strategy like 2D formats to to update the metric validation on the compass on Compass lab I mean.

C

Mm-Hmm yeah, that's a good question, because this this will keep coming up right and you know in this case we removed a whole metric. So that was really obvious.

C

um Other changes might not be so obvious, like we might change the definition of a metric, that's used within a metric model and then how does compass know that they need to change that that metrics model with an updated definition of a metric I mean it's a bigger problem, even than just like the you know, the pull requests to you know to this working group to the metrics models working group. It could also Compass.

E

Could also that's true, I.

C

You know changes to any of the metrics.

D

C

The same thing for the other software right, agar and grammar lab could have the same issue.

D

Yeah I mean I I, noticed like to Sharon will be demo a new sus service today I, and we made my the similar question problem uh after after we, we are trying to deploy new matrix model on the exist matrix model whenever they would be revised in time. So so there's one solution that we at our.

D

In each each of single metrics model, we will add, like auger and Compass, to declare in that definition that these two, these two service has high support, has supported this matrix model. When people want to change or update this matrix model, they may let us let these two servicenow.

D

You need to update your your your service, maybe yeah.

B

I have a suggestion that might be a middle ground between we initial I, don't think we're doing the update last. Are we still doing last review dates at the bottom of metrics, or did we stop doing that now we're not right and we're not doing formal metric releases either.

B

However, we could create a reference point for any tool to say this is the version of metrics that we're using simply by doing GitHub releases on the repo or the metric is contained periodically, and then just say this is part of you know, repository release, 1.1 or whatever, and that covers everything at the repo level. That's how software is released, at least then.

B

If there's a difference between what people see in the metrics model on our website and the metrics model in the tool they can, they can line up the versions of the repositories in some way and that that keeps us from having to do all that granular maintenance. If the metric or metric model level and does give us a reference point for people to have some trust in what they're seeing.

C

Versus proactive right, it relies on, it relies on you knowing so again, it relies on.

A

D

C

That something has changed.

F

C

What's changed and I think the problem is not knowing when something when something changes but I think that there are. There are better automated ways to do this right. I mean I'm, not sure, I'm, not sure exactly what happens within WordPress when it pulls in a GitHub markdown file. That's changed whether there's something we could trigger on that. We could also I mean we could use something like like GitHub actions on the metrics reposed to to take some action. When uh you know when a pull request is merged, when a metric is changed, yeah.

A

C

Automated ways I think to do this, but I'm not sure I'm, not the best place to do it might be in WordPress, because then we could just restrict it to just when the something changes in a metric but I'm not sure. If there's anything we can trigger on there.

D

Yeah actually Shane just remember me, remember me that actually it's a metrics and Matrix Matrix model we had in in chaos. Actually we if we traded that trading as the software they they should have a Version Control. Actually, so, uh when we release a new metric matrix model, which is like so you know, version 1.0 and we should we could have, we could have update the end time after that, so any service depend on this Matrix or matrix model.

D

As a software, uh we should know that the version will depend on it's version, one or version two.

A

Thank you is that a separate issue I mean it I can track it, but is that like a different issue, so maybe issue three.

D

um So I mean yeah, I'm thinking the question. We had it's a problem, we have. uh Should we introduce the motion, control on actual single matrix model or Matrix and The Matrix.

B

It would be the repo level.

B

That we could do it I think.

A

uh Okay, so let me.

A

I definitely cannot type in talk at the same time. um So maybe the first issue Don to your point of this whole thing like having the Google the link to the Google Docs in each of the things, along with the link to the GitHub metric. You know like what we have here and agree that these will diverge. Would it make sense that, even just in this tracking spreadsheet, to start once a metric is released, you remove this foreign.

C

A

And we can keep it here for anything, that's like under in progress or considering, but if it's green, this just should be empty. At that point, that's easy enough to do. That might be a good start.

A

Do people have are people, okay with that.

A

Okay, because I agree with you Don for a while I was actually trying to go into these like copy them and then paste them into the Google Doc to make sure they were always aligned, but it's I think to Sean's Point like unless you do that like every two weeks. There's a good change.

A

Okay, I think that's completely Fair um issue two, which was how to inform Downstream software Solutions um that something has been updated. Elizabeth do you know if there's anything in WordPress that could serve as a trigger that would send anything to anybody like.

F

I think it might be better to do it in GitHub, through, like notifications or like Don, said some some kind of action that would that would notify folks, um just because, like WordPress I, don't know how like auger or Compass would connect to Wordpress. I guess is my question. I feel like they would connect better to GitHub. Somehow.

C

B

C

It's not about them connecting to it, it's about being able to being able WordPress being able to tell us when when something has changed and what that tell us would look like I, you know, I guess it kind of depends.

F

Yeah and we've been having some issues just to be perfectly honest: we've been having some confusion about caching in WordPress. Also, yesterday, I was I was putting some PRS through and it did not update the WordPress page automatically and then I did another one, and some I did four files and some of the files updated automatically and some of them didn't so I had to manually go in and Trigger the update on some. So that piece is a little wonky right now, um I, don't I, don't know.

E

F

I don't know it feels like it's always the other way. It feels like if anything I have to tell WordPress when something has changed, not the other way around. If that makes sense,.

C

Here Arkansas stand up.

E

Yeah the wanted to speak to the Version Control, because we've talked about this for a very long time and we came up with the solution for the Translating, the translating the metrics, because there we had the same issue that the translators needed to know if a metric got changed from One release to the other and I believe.

E

Our solution in the end was that an issue was created when a change was made for the translators to look at and I'm wondering if we can use the same process that we already have in place for the software as well. I just don't know how well this has worked since we came up with the idea.

A

So, do you know if you can have an action from one org drop an issue into another org.

B

You can always I do not GitHub.

C

Github actions are pretty flexible, I.

E

C

Used them myself, but um well I've used I've used them. I've, never developed one myself. You.

A

B

E

C

Have actions that do all kinds of crazy things? Okay,.

B

I've used actions to create issues in other tools in other I'm. Sorry, another repos. As long as it's a public repo and you can use the GitHub API to create an open issue in any repo.

A

Like that might be the most sensible thing that given a change to a metric or a metric model, if we can localize it down to that level, like just say, if there's a change in this folder I, don't want to check on actions that post an issue in the OSS Compass, some repository there, as well as in auger, as well as wherever else we'd want to place an issue, and the issue could just simply be. This has changed with a link to the to the metric or the metric model. We.

F

Could also create a team on GitHub that would have like maybe a liaison from each of the SAS Solutions and then just mention the whole team, like in the issue itself or in the pr itself, just at the whole team, and then everybody whoever designated person is from your SAS solution would get that notification and then it's up to them to take it.

A

I like that, but it just sends a message: not even drops an issue.

C

Maybe do we have um I, don't know if it's anybody on this call, but does somebody want to I feel like this is something we should take offline, so we can get to the rest of the agenda.

C

um Is there somebody that wants to maybe investigate our options and come back to the team, or maybe, if nobody here, maybe we can find somebody else.

B

Is uh is there a web I think the website, like I'm I'm, actually sitting here, looking through the different plugins and it's unclear to me, which plugin is being used to bring things from GitHub I think it might be the just GitHub shortcode, no.

F

It's a special one that Linux foundation made just for us, so there's very little documentation on how it works and it's a little bit wonky. But it's cool like when it works. It's awesome because it does pull that GitHub um straight through, but yeah there's like zero documentation on it. Do.

B

You remember the name of it, probably not.

F

I I yeah I, don't even think it has a name like I think the LF just literally wrote it for us and so there's a website. There's no name like there's nothing. It's like heart, like in the embedded in there with.

B

Our website, I, do remember going through that one with Kevin I can't remember what they called it, though yeah.

F

Kevin might know more about the you know: the capabilities of Wordpress to notify folks or to keep some kind of tabs on what's changed. Somebody.

A

So to Don's point: would somebody like to take on this to take a look at GitHub actions and just kind of see what it can and can't do if we make a change to a document in a repo?

A

F

E

A

Be anybody any takers, takers takers, maybe.

C

Some of the people with the technical skills to do this, aren't necessarily the people in this call or technical Sales Plus time to do this.

B

And my issue would be nice, it would be time like I I, know, Kevin and I spent probably a day dealing with this um Linux Foundation plug-in Elizabeth mentioned when we moved the website or we did the website so um I I, don't.

E

Have that time.

B

This month, um over the summer, at some.

D

Point yeah, maybe I I, also don't have time this month, but uh I I can't do next month. Actually yeah like.

C

This one, you know what this isn't urgent. Why don't we just file this as an issue and either the common or the metrics model working group and see if somebody has time to pick it up and then, if not one of us can maybe get to it in a month or two over the summer, when we've got a little more time, because it's not it's.

E

C

Super urgent: it's not! We have to do this right. This minute, yeah I think we've got time to sit on it a little bit.

E

B

B

And it's literally a blank HTML page yeah.

F

I looked at it yesterday, because I was trying to debug those things yeah, it's literally playing all.

A

Right uh cool! Thank you. It's a good conversation, um Sean, I, I think this is probably you, but.

B

You yeah yeah I, just wanted to show clear your.

A

B

It's it's nominally. It's not yet fully related to metric models, because we haven't labeled or implemented metric models, but we have implemented um a number of things that are two two, uh a couple of tech companies, the things they want to see right away.

B

So if we look at the chaos org, you can see commits issues, pull requests at a real high level and then they have three dash plotly Pages. This is all based on auger data, where they generate uh Graphics contributor growth by engagement, new contributors by month. Of course, always during a demo, it goes slow for me um issue. Staleness issues over time commits over time. I think uh yahui, where this is uh not as well architected as compasses.

B

We use the same database for inserting data as we do for retrieving data and right now we're in the process of inserting 22 000 repos for numb Focus, um so that one's coming up slow. Let's see if the chaos one loads any faster.

C

B

So it's in uh it's in much it's an earlier Alpha type of release, and eventually all of this will come up, but it is not coming up for whatever reason right now, Beauty women.

B

Maybe if I stop switching tabs so fast I thought I saw a graph there for a minute.

B

Well, we don't need to waste time on this, but you can create a user and if you click manage groups, it opens up a tab to Auger and you can create a new group and you can put in any org any org repo combo, full URL, and if the data is already in the database, it'll just give you that data right away. If it's not it'll cue, the data for collection, so probably the most useful part of it is how easy it is to just add repos to it.

B

um I just wanted to point it out, because I did open for all of our released metrics models. I I have issues open on. This is a tool called oss-as aspen8not that reads auger data and for each tool um for each metric model that we've released. There's an open issue to create the metric model here as well, and we did Matt so separate from this- not sure why I'm going slow this morning but I'm sure it's because I'm loading, a ton of data, so I'll stop sharing and Status time when the data comes back.

B

Maybe I'll share once more. At the end.

A

um This Sean is the intention to to deploy metrics models like what.

B

They've done yeah yeah see. My intention is to deploy metrics models, I think from the perspective of uh red hat and a few other companies.

B

um The purpose is to deploy the metrics that they think are important to look at together and those don't necessarily those don't precisely correspond with what we have defined as metrics models. But the origins of our metrics models are very similar.

B

um There are groups of metrics deployed together for a purpose and, like I, said, I've opened eight issues to create the metrics models that we've released um in this tool and to try to make just like with compass to try to make some things available for people that they can experiment with, but obviously it's it's not as far along as compass in terms of the performance engineering right now so.

A

Are the issues the issues are metrics models that haven't been released like metrics.

B

Models that have been released that we have not yet here they're released here, but not deployed explicitly as those metrics models in this in metrics.cast.io.

A

Okay, do you have models that are not on this list that you have deployed.

B

I think so what I need to do is a sort of a comparison between which things are on which pages and what things are in what metrics models and see? Okay, if there's so perhaps just a few things missing to make it an implementation of a metrics modeled, but I haven't done that analysis. Our goal was to have this up for chaoscon, which we did and then Red Hat has their Summit starting today and so they're demoing their version of it there.

B

um This is the public version of it that I showed you.

A

Okay um questions comments for Sean on this.

A

This does raise just kind of one ongoing thing that I think about a lot which is like we have tools sometimes or is gay Eric's still on, like you have your, you know how you have your like metric stuff of the month. You know what I mean or like models like I'm, not quite sure how we, how we connect um or like the dashboards from grimora Lab, how we connect, what's been developed in software, to to kind of a written specification that we track here.

A

That seems to be a bit of a problem not like event, but something that I think about how to overcome. So.

D

Like a piece of software,.

A

For this thing, and then we don't have it captured here, we've.

B

We've I think we've laid the ground so at the very beginning of chaos, project auger actually linked back to the metrics that were affiliated with our API endpoints. Then we just stopped doing that, because the location of the metric kept changing in the GitHub repository around the website. But now we have stable URLs for each of the metrics.

B

So now I think the tools are able to to provide that chaos reference again and that's a pretty recent development that we have, that consistent metric and so I think in a perfect world than every project would use the the consistent permanent URL to indicate that this is an implementation of this chaos metric model or this chaos metric that that would be the road map. And you know we only had those stable URLs for maybe six months.

A

Yeah, that's right.

E

The conversation for taking the the work that is done in the implementation and the software back into the specification I know we have the conversation on slack for the risk assessment framework uh blog post, that I authored and my hope right now is that I'll take some time off next week and then I would be happy to start the draft to get that in okay.

A

E

A

That connection right, that that I was talking about, um we don't have that reference point at all, but yeah that'd be great.

B

Okay yeah and it's on our roadmap to put that those links back in auger, because we have chaos metrics implemented, we just stopped providing the links. Mine's really us described.

A

Mine's really the other direction, so you implement something in auger, yeah.

B

And then have that.

A

If we don't have like documented here as a reference point so like how because like even those graph that you were showing in eight, not Aug or eight knot, yeah, both those are a little bit different than what we have here documents, and so how do we get like what you have deployed in in your software environment to be documented? Here? As a reference point, that's the question. There seems to be some problem and again it's not like I think about this, like how do we improve that process?

A

Yeah identify what you're doing in software and then get it developed here, yeah.

B

I think I think most of the most of the graphs um do have a chaos metric behind them. I, don't think the pages have a metric model behind them.

B

And that therein lies the The Challenge and then there are some times where grimorlab and agar create things that are not metrics. As you described and I guess, the question is like, for example, grammar lamp has 70 or more panels in um signals.

B

You know that's a lot of work to go through all that and if there's not a metric or a model that reflects it to then create that yes, um and it would be that's it. You.

D

B

So I mean I, think I think this is almost uh on the scale of an initiative to systematically uh support. Try like for each project to prove like I, think um actually Compass does the best job of linking the chaos information directly to what's on the page and I think for more lab and auger and ain't.

B

Not um it's an initiative to you know for somebody that works on each of those projects to say here's how you identify whether or not there's a metric and here's how you include the link so that metric, if it exists and here's how you propose a new metric if it's on the page, but it doesn't exist right and you know we provide a process for each tool and engage the community in in making those additions.

B

um That would be sort of my ideal Vision like I, don't know what Georg thinks from a gorillac perspective, but.

E

A

I share that Vision, it's just the like how how to make that process work, that's I! So, anyway, we can move on. It's just maybe something to think about. For everybody. I know we have a couple other things on the agenda today.

C

Oh sorry, go ahead.

E

I already said what I wanted to say: I just wanted to put in my plus one.

C

C

Entering Google summer of code student, somebody who could use the metrics and you know, work with the auger team work with the grimmar lab team and identify all of the metrics in those platforms and then file issues in the appropriate working group for any that don't exist.

A

Like just give some initial structure even to the metric or metric model, just like approximately this is what a description could be. Yeah.

C

Or, if nothing else, um you know put uh exactly how it's been calculated within the tool. That's that's using it. So.

E

Interesting, the pressure seems to be doing that kind of thing: she's, building a comprehensive list of metrics in auger and grimoire lab I, don't know if any of you is familiar with her work right now,.

B

Yeah I'm giving her the list of um of metrics in auger, but, like we don't have I can't we don't have any reference points to where in auger it exists like on the page.

E

Maybe talk with her and I.

B

Don't think you're more Lobby.

E

No, no, we don't, but if she's already doing part of the work halfway, there maybe talk with her to see if he can go the next step with her.

B

Yeah it's an excellent idea. I do have the I do have the site working again there's an order of operations. We were working on it last night and I. Didn't you have to restart. You have start auger before you start eating out. So that was what my problem was. Okay,.

A

um Elizabeth, do you know about this work that precious is doing.

F

If I knew a list were and I did not have that answer Sean in the auger team in slack, but I didn't know that she was working on that she was looking for that. So.

B

Yeah and we've been we've been corresponding um non-slack, but an email um and uh I'm gonna get her that list this morning.

A

B

A

I, like this I, like the idea of an mentorship opportunity too, to help kind of structure that work, so, okay, um Compass lab metrics components. Did you put this here.

D

Yeah, it's me: okay, go ahead! uh Actually, I I have one one more question to share that. um Have you ever talked to students in in European countries or in USA that they are willing to help us to to doing the auger implementation, algorithm level, implementation.

B

So say it again, so you have students who are interested in doing implementation. Work with grimore.

D

Lab and auger yeah yeah yeah yeah.

B

D

I mean I mean I, actually uh have a conversation with the students in in China from different universities.

D

uh Actually, they do not have so much show so much interest on on helping us to to Implement those metrics directly. They are more care about the data analytics after you know, week out the week out the refund the data instead of to to implement how to uh fetch the data and clean the data. That's the big issue for me to implement Compass to Trend when I'm trying to get support from those students. What.

B

Yeah I mean I, I, I'll, I'll, say agars, never had a beautiful front end and at chaos kind of characterized it more as a data engineering tool which is really what it is, because the work that we've accomplished is every time. There's a new data anomaly that comes from a platform or a git log we handle it.

B

You know we put, we do a pull request and we fix it and you'd be surprised at how often there are new data anomalies or subtle changes to the types of data returned by apis that need to be addressed so and I think grimoir lab. Similarly, for the way they collect, data with Percival um has to deal with that routinely as well. So I do think. We have um some really good data engineering tools that they could use and perhaps help to improve compass in that in that way, yeah is.

E

That what you were.

B

Asking Yahoo here or did I miss the boat.

D

Yeah I, actually I'm I'm, also trying to seeking support from for more people outside of that community. From the universities, students who.

A

Is it students that have an interest in asking questions against the data that has been collected so less about like actually collecting the data but asking say protecting questions? Okay, so I mean as part of it. You know we are going to be moving towards. You know kind of a data science approach, probably a little bit later this summer, and that's probably something we could think about as to how to include people that may have questions against the data that is collected and how to do that effectively.

A

So I think probably more to come on that in the next couple months and and these questions would be I mean I. Think they'd potentially be you know, platform agnostic. You know like whether it's on Compass or auger or more lab. You know how we think about the data that is generated from them. I think the question still might be the same and I think that'd be very interesting and I think that's something we're very interested in doing in the chaos project, starting a little bit later. This summer, I.

D

Hope so yeah cool.

A

Okay, great, um so that's not this! So do you want to talk about this a little bit.

D

Yeah yeah, that's the topic. I want to discuss today.

D

Yep go ahead. uh I'm trying to I I can show my screen yep. Thank you.

D

Where's my screen, okay, here.

D

A little bit more uh to remind you, I I'm, not sure if you remember it, but but I I would quickly go through the whole instruction of the compass lab. uh No okay, here's the thing uh the this the compass lab. If we uh we already done for the starter project, Health matrix model and but um the way we collaborate with the between the chaos and and the compact is that after this com, matrix model, D1 definition is completed in in chaos and the members from Compass would start.

D

The validation and the implementation in the compass I mean under the compass lab, but I'm thinking that if we could implement or discuss a new matrix model and mean mean times like we can create bioset of student discussion. That would be great, so um I mentioned here. A little bit create your own models in five minutes. Yep select the data site. We provide and select Matrix. We we had that support metrics and under under matrix model. Sorry actually I think we already have this this one.

D

Yep select, Matrix five uh 100 Matrix, originated from chaos and select the algorithm and publish models, and that's that's our thinkings create this matrix model. So uh the precisely diagram- and you can name your model here and the select the data site- will provide some data sites from different categories and select the Matrix we already had and Implement in compass and originated from chaos, and actually that's the topic I want to discuss today and how to implement how to how to add some priority out there as different priorities and then select the algorithm.

D

So here is the The Next Step, but you know how to add a data site. You want to choose for a new Matchbox model and and in in this matrix model, which Matrix you would like to use. You can select one of the or three or five or 10 uh yeah. That's the data sites and unselect the metrics and select up to 10, metrics or more and then select the algorithm you can. You can have some. We can provide some default algorithm or you can.

D

You can Define it by yourself and after that you can let people to invite people to working together with you on this new matrix model creation and and actually I'm start doing so from sniper by uh step by spice type and the data size really high. Actually, so that's not a problem. The thing is that to be you know in case we have many many metrics that already defined in chaos and I've. Only I I want to um pre-ordalized those metrics which should be deployed or implemented at first. So.

D

A I create a table. Actually this I copied from this one.

A

Sorry I know what you're talking about yeah.

D

Yeah, this was uh I, think it's created by by much right, so we have matrix model and each metrics model have different Matrix and I copy this sheet, and here we have the matrix model in chaos and also deployed in in compass. At the same time as first the column I default, I listed The Matrix we already supported in the compass and here is the link I'm, showing sorry.

D

uh This the metric is, is mapping to this the matrix definition in chaos. This is the deployment I am showing here it's using the uh kubernetes.

D

Yeah this one uh so.

D

So I list all the matrix model we already supported in in compass and at least the awesome Matrix. We support it in compass under this matrix model and I want the Implement in the those Matrix as either as compost light component. uh What.

B

I mentioned here so that, uh from a software engineering perspective, that's kind of a brilliant way to do it, because then you have a component for each metric and if we're using the metric in multiple Matrix models, you just drop that component on the metric model, page right.

D

Exactly exactly yeah no.

B

It's so it's really a really good engineering strategy. I, like it.

D

Yeah all right so I mentioned, because we have so many metrics already uh I wanted uh chaos. People help help me to define the prayer priority, which one should be implemented. First, as a compass lab component. Then they can. They can start implementation, those Matrix components in compass. After that people could could select the matrix model. Sorry, Matrix components.

D

To to compose a new matrix model, and then the working progress could could be going forward differently. What I mean this.

B

So this um I'll just say my first. My first answer would be identify any metrics that are part of more than one metric model and the metric with the highest end of participating in metrics models. I would put those the highest yeah sure yeah, but it's yeah it's it's. uh Obviously you know I mean. Obviously this is one of the tracking it spreadsheets are great answering that question spreadsheets make it happen, it's not as easy to figure it out.

B

um Yeah, but I think it would be so easy to take this one actually put in a database table and count.

D

Yeah so I'm trying to do a something like a survey like to to let people know which metrics you have more interest, long to use in the future matrix model, and we could pick up those metrics metrics to be implemented as a compass component.

A

From my perspective, I agree with Sean that any metric that is appearing in more than one metric model seems to be a good candidate. I would also just say kind of from experience. It does seem like a lot of the metrics that were released in the evolution. Working group are kind of very Atomic metrics generally and might be good candidates for for this, and there are things we end up talking about a lot pretty often as they seem to to be pretty Broad, and then the second working group is common.

A

The metrics that are in common also seem to have pretty broad reach. At least this is just from my own personal experience in the chaos project over the years. I'd.

B

I'd also add from a software engineering perspective, most things that are related to pull requests issues or commits the the component is just going to be a slightly different view of mostly the same data.

B

So, for example, once you build your first issue or pull requester commit component um there's there may be like uh sub components or core Library pieces that can go into any component related to a PR, an issue or a commit, because these are core objects and be reused and provided different parameters in the component for the specific metric about those things.

D

A

That's true, so we are at the end of time. This seems like a pretty reasonable conversation to pick up on slack as well and I. Understand your question. Yahoo and I'll take a look at this tab. Do you want? Do you want people just to use the drop down boxes that you put in there or the.

D

Yeah yeah, please do so.

A

Yeah is that, okay, if like I just make a judgment, call and just say hi or low, because okay I can I.

D

A

D

Okay, thank you.

A

Yeah, no. That sounds great thanks for thanks for doing this, and thanks for kind of building out that prior tab as well um anyway, we're at the end. There were some metrics models that I did move forward.

A

One was around um project influence, so we'll pick that up next time or I'll put it in the in the slack Channel and then likewise I do think we do I think we have a couple metrics models looking at them today that are done, for all intents and purposes, um so it'd be great to get some closure on some of those as well as we continue to not only develop software around these models, but the models themselves. So anyway,.

B

Who is there a link to that spreadsheet? That.

A

You're sharing it's just in our metrics trackings, but.

B

D

B

The metrics tracking spreadsheet, okay I, was making it too hard.

D

In the last sheet, yeah yeah, okay,.

A

Everybody thank you very much for your time and energy today, I think most people like I learned that everybody likes trains amongst the many things I take away from today. All right, everybody till next time take care bye.

E