CHAOSS CHAOSScon NA 2021, 11 Dec 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Building metrics models based on the state of the art best practices | Xiaoya Xia & King Gao

Description

Building Metrics Models Based on the State of the Art Best Practices

The purpose of defining metrics is to continuously improve the workflow, empower open source projects with the capabilities of governance, operation, and development. We looked into some best practices of the benchmarking communities in the industry on how they measure and govern the project, and constantly explored which metrics and factors will affect the results of measurements. This talk will further seek connections among the current metrics and build a set of models, not only to address existing problems in communities, but also to predict the direction of future community development.

A

Hi everyone, I'm so thrilled to have this opportunity to give this talk on chaos con 2021st. uh So, together with king, we will present the topic building metric models based on the state-of-the-art best practices.

A

So, as a student who has over two years of experience in open source, I will first talk about the characteristics of an excellent community, combined with some of the best practices from the open source industry that I observed and came with them present a framework of open source communities based on chaos metrics, and how to find how to find the connections to build metric models.

A

uh So what are the characteristics of an excellent community? The first element is paypal.

A

There is a classic onion model to describe browsing open source from a user to a contributor to a commuter, and even we can become pmc leaders.

A

uh We can simply look into the contributor and maintainers field, so many community will require contributors to sign a cla or dco, it's more of for the sake of the community to avoid intellectual property conflicts when contributing code and also during the during the community participation.

A

The code of conduct should be clarified and be complied, and there are some other social norms that are predefined, because each community is like an independent village with with its own social culture that requires contributors to do their homework first, to learn the basic questions uh in advance like uh the basic for uh wwh questions um instead of just stumbling.

A

um This also requires maintainers to take enough patience and responsibility. The best practice here is the apache way. um I I list some of the points um about making the community based built on trust, trust and consensus by actually. By summary, the people in a good community is respect and responsibility.

A

um People should should show respect to each other um be responsible and a coordinating guiding guiding prison power here is diversity and inclusion.

A

Let's then, look at the organization perspective if we are divided divide the community structure from open or closed and led by individual or led by company, we will have a two-dimensional quadrant with four governance types.

A

So the apache foundation is an open and successful community led by individual developers.

A

The governance principle is transparent and marital crisis, americas, etc.

A

While most of the contributors in cncf comes from, companies, company could lead the direction of the community, while it's still openly governed by the foundation and the openness can be influenced by the strategy of the company like android, mongodb, etc. They allow users to participate in. They allow users to participate in, but the project is controlled by maintainers who from the company and the structure also evolves as the community grows. I like the picture on the right side uh with a single project.

A

Rows are simply contributors, maintainers and owner.

A

And with multi-project to govern to government a technical committee, as known as tlc, will be set with a certain number with a certain number of projects.

A

It becomes a foundation governed model and aside from tlc now we also need user committee, marketing committee, etc, and now the foundation now is from the um always from aboard a board of director team to lead the strategy level of decisions.

A

And the third characteristic is development.

A

The development workflow in open source is actually the agile model, um release early and fast adoration, so an efficient collaboration, workflow and even automate automation, trolls, are important, um frequently occurred. Concepts here are devops um aka development and operation and and to um assure the quality in the same time and ci cd develop um continuous integration, continuously delivery and continuous deployment.

A

um Let's now look at a project named reproducible boots. It's a set of software development practices that create an independent, verifiable path from source to binary code. um The keywords here are: reproducible and verifiable.

A

It's a part of the chain of trust by promising identical results are always generated from a giving source. That is, you can always produce exactly the same binary code. It allows verification that no vulnerabilities are introduced into the components so open source component security is a critical topic during development.

A

It suggests on the process of releasing and delivery. Unlike federal, um the really the release. Engineering philosophy of federal is repeatable, auditable, definable and deliverable.

A

So how do other practice do? How do they do when measuring the community?

A

um We can see three examples: apache apache, look at it from community development and community governance, um community development will code license and copyright a release, version and quality are the elements that are highlighted and community governance, where it looks at the community consensus and independence and uh cncf divide divide the majority of projects to three levels: graduated incubating and sandbox, and this is voted by cncf tlc.

A

And one of the oh sorry, um one of the basic um requirement is to achieve and maintain a cia best practice badge. um So how does the ci badge evaluate a project?

A

It focus on the it focus on the security perspective, look at look looks at the some basic elements like websites license and documentation and change control, um the vulnerability and bugs quality and tests, and and so on, so to have an uh to have a conclusion we can see. Despite of different focus and dimensions, uh the element and practice are highly overlapped actually and that's why we need to integrate them and read them up as metrics.

A

This is how I look at kiosk, an open source community itself. I mean for um how to make a better community. So um now king will talk about more about a framework and metric models.

B

Thanks to shaya for shane and came from china, I will continue to share our insight-based environmental framework for open source community and how metrics are connected to a form, a model and the supporters from work. This is the first is our measurement framework, which is divided into four layers. I will analyze it from the bottom up. First at the bottom is the awareness and culture of the community perspective accidentally participate, makes accident communities and accident projects such as respecting others. Toxic cheap show me the code exactly.

B

Second, the middle is the behavior of the communities participating in the process of the governance, development and the operation after they have good awareness and capture.

B

There are five dimensions after the boat at the bottom is the base data information, including one person's metadata, which is when who and what information generated by the behaviors of the community participating in the community as a common work group of the chaos community at the top left is a content related to the governance of the community.

B

It includes organizations even processed under specifications.

B

The effect of accident governance is more diversity and inclusive, and in the middle, is how community development process and the operations which can better support the development process and how community grows and evolves.

B

The process of the development is the workflow of the gate and at the end of the process, continuous improvement, which is the means of the chaos project. That's the meaning of the chaos project to help the communities continuously improve from the behaviors process and to the better future.

B

Third and up layers, there are excellent characters of the products and the projects produced by the community participating communities, characters.

A

B

Organization are open, transparent diversity and inclusive outstanding feature of the project is a compliance security and the complete new delivery.

B

The contents of this section is also relevant to the risk domain of the chaos metrics, the value present by the at the top, the value present by the business, the value of the organization, the value of the individual people person and the content of the very work group of the chaos is extracted and since all the process and the results in the big house are marrow, the following slide shows the matrix that have been released by the current activity.

B

I have draw the chart of point. We can match the matrix on the previous slide page. It is a pleasure that the metrics I contribute are also including.

B

uh We also mentioned that the measurement is now to the goal. It's aimed to continuously improve and build more compliance, security, diversity and inclusive community and involve more developers.

B

The current indicators are quite complete and we are constantly improving too many indicators will bring problem. How should I look at them which indicators so we need a model that make it easier for people to understand the health of the project before starting the model. We need to think about how the magic I relate to the modem.

B

There are some of my thoughts which are welcome to discuss. We are looking for links between the indicators and I think about the fully links.

B

Renault, uh cleaner logic, inclusion, logic, impact and no connection. The criminal logic is easy to understand. It's similar to the upstream and downstream process of the pipeline. In the following example, open issue should be followed by the issue command.

B

The inclusive inclusion relationship is that environment period contains many small operation period. For example. Processing a period of the issue must including the comment period and the label duration.

B

The logic relationship is not a direct airplane relationship is that a magic change may bring another magic change. For example, the large number of the issue common, the more different people may join them community and comment, but only one person may comment, so it's possible consequence, but they may be strong or weak links at the last ones, two magics that have no relationship at least for now. We don't see any factors that affect each other, such as the license companies and the vulnerability attending the simplest relationship in this is carino logic, uh chronologic and inclusion.

B

Based on this, uh I tried it. First, I just participated in the chaos project and found the simple kit workflow simple list it followed to do it. I think link linked the metrics that have been discussed in the issue and requests can see the relationship between the outer and inclusive, and this is output was also contributed to the health.

B

Let's thought about the relationship between the issue and request, which is that I did this year. Therefore, so the following model is created. I link the issue and appear through the indicators of the branch like branch left circle, because the prequest starts from the issue. No matter the issue is requirement, function, feature or box.

B

An issue should be opened. First, then, the the merge and the issue closed at purpose. Another magical validation relates to issue associated with the prequest. A complete data development workflow model is generated.

B

Now, we're glad that we have established the matrix model group. We can explore more model together. There must be logic relationship in the matrix model, work group. They are also very interesting. We welcome you to join the magic motor world group for discussing and welcome more people to join the chaos community.

B

We will have conclusion of the idea together, I'd better.

A

B

The help from your community and giving me this opportunity to share, I hope you can it and we can grow it soon.

B