23 Feb 2020
Application of Health metrics on a Cross-sector software ecosystem
Business and software ecosystem health can be considered as a key performance indicator of an ecosystem's potential to create opportunities for its members.
In this talk Johan will present the practical application of ecosystem health on JobTech Dev, a software ecosystem of job-matching actors in Sweden. The ecosystem is lead by the Swedish Public Employment Service and is underpinned by open data and open source software that is used and co-developed by the whole ecosystem.
Elicited metrics cover the ecosystem's productivity in development and maintenance, robustness to withstand change and disruptions, and openness for new business applications, use cases and external contributions.
As the metrics has just been introduced at the Employment Service, Johan will share some initial lessons learned and discuss the roadmap of connecting the health metrics to impact metrics relating to the ecosystem's common vision of improved job-matching on the Swedish labor market.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/application_health_metrics.pdf
-----
Johan Linåker
Postdoctoral Researcher - Lund University
@johanlinaker
Johan is a postdoctoral researcher focusing on how the public sector can create platforms with open data and software on which ecosystems of actors can innovate through cross-sector collaborations. In his Ph.D., he focused specifically on helping companies make contributions and engage with communities in alignment with business goals. He sits on the advisory board for Hack for Sweden, the Swedish governments gov-tech initiative for enabling open and data-driven innovation. He is also the founder of OpenHack, a non-profit tech-community solving real-world challenges connected to the global goals in Agenda 2030.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
Business and software ecosystem health can be considered as a key performance indicator of an ecosystem's potential to create opportunities for its members.
In this talk Johan will present the practical application of ecosystem health on JobTech Dev, a software ecosystem of job-matching actors in Sweden. The ecosystem is lead by the Swedish Public Employment Service and is underpinned by open data and open source software that is used and co-developed by the whole ecosystem.
Elicited metrics cover the ecosystem's productivity in development and maintenance, robustness to withstand change and disruptions, and openness for new business applications, use cases and external contributions.
As the metrics has just been introduced at the Employment Service, Johan will share some initial lessons learned and discuss the roadmap of connecting the health metrics to impact metrics relating to the ecosystem's common vision of improved job-matching on the Swedish labor market.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/application_health_metrics.pdf
-----
Johan Linåker
Postdoctoral Researcher - Lund University
@johanlinaker
Johan is a postdoctoral researcher focusing on how the public sector can create platforms with open data and software on which ecosystems of actors can innovate through cross-sector collaborations. In his Ph.D., he focused specifically on helping companies make contributions and engage with communities in alignment with business goals. He sits on the advisory board for Hack for Sweden, the Swedish governments gov-tech initiative for enabling open and data-driven innovation. He is also the founder of OpenHack, a non-profit tech-community solving real-world challenges connected to the global goals in Agenda 2030.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 1 participant
- 17 minutes
23 Feb 2020
CHA-IO-SS - Community Health Analytics for Inner and Open Source Software
CHAOSS has been on the ground for the last couple of years with a strong focus on open source. Indeed at the very beginning there was some discussion to have included in the mission and vision of the community the term InnerSource that was lately removed. What if we think for a while about InnerSource in the terms of metrics? As active member of the InnerSource Commons, it is worth mentioning a list of them and how behaviours that are assumed by default in open source communities (collaboration, transparency, communication) do not even exist at the InnerSource level. This talk aims at fostering some discussion internally at CHAOSS with the purpose of understanding InnerSource requirements and how with the same infrastructure, metrics and discussions we're having, CHAOSS may become at some point some standard in the industry about software development metrics (and not only open source software development metrics).
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/cha-io-ss.pdf
-----
Daniel Izquierdo
Director of Consulting - Bitergia
@dizquierdo
Daniel Izquierdo Cortazar is a cofounder at Bitergia, a company that provides software analytics for open source and internal ecosystems, where he’s focused on the quality of the data, research of new metrics, analysis, and studies of interest for Bitergia customers via data mining and processing. Daniel holds a PhD in free software engineering from the Universidad Rey Juan Carlos in Madrid, where his research focused on the analysis of buggy developer activity patterns in the Mozilla community.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
CHAOSS has been on the ground for the last couple of years with a strong focus on open source. Indeed at the very beginning there was some discussion to have included in the mission and vision of the community the term InnerSource that was lately removed. What if we think for a while about InnerSource in the terms of metrics? As active member of the InnerSource Commons, it is worth mentioning a list of them and how behaviours that are assumed by default in open source communities (collaboration, transparency, communication) do not even exist at the InnerSource level. This talk aims at fostering some discussion internally at CHAOSS with the purpose of understanding InnerSource requirements and how with the same infrastructure, metrics and discussions we're having, CHAOSS may become at some point some standard in the industry about software development metrics (and not only open source software development metrics).
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/cha-io-ss.pdf
-----
Daniel Izquierdo
Director of Consulting - Bitergia
@dizquierdo
Daniel Izquierdo Cortazar is a cofounder at Bitergia, a company that provides software analytics for open source and internal ecosystems, where he’s focused on the quality of the data, research of new metrics, analysis, and studies of interest for Bitergia customers via data mining and processing. Daniel holds a PhD in free software engineering from the Universidad Rey Juan Carlos in Madrid, where his research focused on the analysis of buggy developer activity patterns in the Mozilla community.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 3 participants
- 20 minutes
23 Feb 2020
Diversity & Inclusion Badging Program
The Bureau of Labor Statistics shows that employees in the field of “computer and mathematical occupations” are 25.6% female (Bureau of Labor Statistics, 2019). A lack of D&I is not only a known problem but also acts as a barrier for potential contributors becoming involved with IT as a lack of D&I will perpetuate complacency (Irwin, 2018), avoidance (Sterling, 2016), and a negative collective conscience (Blincoe et al., 2019). Within IT, open source software exhibits some of the worst D&I. The open source survey run by GitHub states that only 3% of contributors to open source software are female (GitHub, 2017). While open source has made strides in some aspects of D&I, such as event inclusivity (Irwin, 2017) and community engagement to support organizational diversity (Alexander, 2019), work remains. The proposed is aimed at contributing to this positive growth through the development of a D&I badging system. In open source, badges are available for community leaders to publicly display, providing a way for projects to signal their attention to such things as community health and software security. Known examples of software badging systems in open source include the CII Best Practices Badge, Black Duck Security Risk Badge, and the PyPi Python Coverage Badge. We can draw from this badging work to improve D&I in open source. While software badges present solutions for most goals of software development, no badge has been created to support D&I initiatives, and the proposed talk aims to advance these efforts. In this talk, I will discuss complexities associated with D&I metrics and propose a D&I badging system that provides open source communities the ability to make diversity and inclusion within open source projects more transparent.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/BadgingforDiversityInclusion.pdf
-----
Matt Germonprez
Professor - University of Nebraska at Omaha
@germ
Matt Germonprez is the Mutual of Omaha Professor of Information Systems in the College of Information Science & Technology at the University of Nebraska at Omaha. He uses qualitative field-studies to research corporate engagement with open communities and the dynamics of design in these engagements. His lines of research have been funded by numerous organizations including the National Science Foundation, the Alfred P. Sloan Foundation, and Mozilla. Matt is the co-founder of the Linux Foundation Community Health Analytics OSS Project (CHAOSS). He has had work accepted at ISR, MISQ, JAIS, JIT, ISJ, I&O, CSCW, OpenSym, Group, HICSS, IEEE Computer, and ACM Interactions. Matt is an active open source community member, having presented design and development work at LinuxCon, the Open Source Summit North America, the Linux Foundation Open Compliance Summit, the Linux Foundation Collaboration Summit, and the Open Source Leadership Summit.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
The Bureau of Labor Statistics shows that employees in the field of “computer and mathematical occupations” are 25.6% female (Bureau of Labor Statistics, 2019). A lack of D&I is not only a known problem but also acts as a barrier for potential contributors becoming involved with IT as a lack of D&I will perpetuate complacency (Irwin, 2018), avoidance (Sterling, 2016), and a negative collective conscience (Blincoe et al., 2019). Within IT, open source software exhibits some of the worst D&I. The open source survey run by GitHub states that only 3% of contributors to open source software are female (GitHub, 2017). While open source has made strides in some aspects of D&I, such as event inclusivity (Irwin, 2017) and community engagement to support organizational diversity (Alexander, 2019), work remains. The proposed is aimed at contributing to this positive growth through the development of a D&I badging system. In open source, badges are available for community leaders to publicly display, providing a way for projects to signal their attention to such things as community health and software security. Known examples of software badging systems in open source include the CII Best Practices Badge, Black Duck Security Risk Badge, and the PyPi Python Coverage Badge. We can draw from this badging work to improve D&I in open source. While software badges present solutions for most goals of software development, no badge has been created to support D&I initiatives, and the proposed talk aims to advance these efforts. In this talk, I will discuss complexities associated with D&I metrics and propose a D&I badging system that provides open source communities the ability to make diversity and inclusion within open source projects more transparent.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/BadgingforDiversityInclusion.pdf
-----
Matt Germonprez
Professor - University of Nebraska at Omaha
@germ
Matt Germonprez is the Mutual of Omaha Professor of Information Systems in the College of Information Science & Technology at the University of Nebraska at Omaha. He uses qualitative field-studies to research corporate engagement with open communities and the dynamics of design in these engagements. His lines of research have been funded by numerous organizations including the National Science Foundation, the Alfred P. Sloan Foundation, and Mozilla. Matt is the co-founder of the Linux Foundation Community Health Analytics OSS Project (CHAOSS). He has had work accepted at ISR, MISQ, JAIS, JIT, ISJ, I&O, CSCW, OpenSym, Group, HICSS, IEEE Computer, and ACM Interactions. Matt is an active open source community member, having presented design and development work at LinuxCon, the Open Source Summit North America, the Linux Foundation Open Compliance Summit, the Linux Foundation Collaboration Summit, and the Open Source Leadership Summit.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 6 participants
- 19 minutes
23 Feb 2020
Emerging Tech Open-Source Scoring System (ETOSS)
This is a framework used by the UNICEF Innovation Fund, to evaluate and track the strategic position and growth potential of the early stage startups in its portfolio. The focus is on startups building open source frontier tech: Blockchain, Data Science, Artificial Intelligence and Extended Reality. It classifies the startups into four quadrants, based on two dimensions: the software developed (technology), and the financial sustainability of the project (business sustainability).
Essentially, each startup gets a final scoring for each of the two dimensions that helps position them in a matrix-kind of graph. When placed in the top right corner of the graph, the startup would have a high level of development in both dimensions. The final scoring is calculated through the weighted average of the score given to a series of key performance indicators depending on how strong they are. In the case of the ‘technology’ dimension, the calculation includes: GitHub Code Activity (Stars, forks, Commits, Contributors, Pull requests, Issues Tracking); Code Test Coverage; Open Source License Status; User Testing #; Prototype Readiness. In the case of the ‘business sustainability’ dimension, the calculation includes: Revenue, Expenses; Profit Margin; Number of Users and User Growth; Amount of funding received and number of third party funders (aside from them and UNICEF); Team sustainability (including tech and business skills as well as gender diversity).
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/chaoss_fund.pdf
-----
Cecilia Chapiro
Investment Adviser & Blockchain Portfolio Manager - UNICEF
@ceciliachapiro
Cecilia is the investment adviser for the UNICEF Innovation Fund where she leads the sourcing and selection process of open source and frontier tech start-ups in developing and emerging countries. She also manages the blockchain portfolio of investments and developed the measurement model to track the progress of all companies in our portfolio (including extended reality, IoT, drones, blockchain, data science and AI).
Before UNICEF, she founded Yunus & Youth, supported by Nobel Peace Prize recipient Muhammad Yunus where she has helped grow social businesses in more than 40 countries. Cecilia has eight years of work experience in the for-profit sector (Johnson & Johnson), the non-profit sector (Junior Achievement, Ashoka, AIESEC, ‘Techo’), and the international field (Organization of American States, Grameen).
Originally from Argentina, Cecilia has lived and worked in Australia, Bangladesh, Brazil, England, Germany, Spain and USA. She holds a Licentiate in Business Administration from ‘Universidad de San Andres’ and a Master’s in Public Administration from NYU where was a founding member of the first NYU student led Impact Investment Fund and she attended as a Fulbright Scholar.
Justin W. Flory
Open Source Contributor
@jflory7
Justin W. Flory is a creative maker. He is best-known as an open source contributor based in the United States. Since 2018, Justin is a leading member of the LibreCorps program of the FOSS@MAGIC initiative at the Rochester Institute of Technology. He was the first, full-time co-op placement to work exclusively on community issues for UNICEF Office of Innovation. This was work he did in concert with UNICEF personnel and Red Hat Open Innovations Lab on UNICEF’s MagicBox effort. Since then, Justin led workshops for UNICEF’s Innovation Fund to introduce over 20 international start-up teams to the Open Source way. Currently, he works as a consultant for open source projects and community-building. Using Justin’s initial efforts with MagicBox as a starting point, RIT’s current LibreCorps mentors build interactive resources for clients.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
This is a framework used by the UNICEF Innovation Fund, to evaluate and track the strategic position and growth potential of the early stage startups in its portfolio. The focus is on startups building open source frontier tech: Blockchain, Data Science, Artificial Intelligence and Extended Reality. It classifies the startups into four quadrants, based on two dimensions: the software developed (technology), and the financial sustainability of the project (business sustainability).
Essentially, each startup gets a final scoring for each of the two dimensions that helps position them in a matrix-kind of graph. When placed in the top right corner of the graph, the startup would have a high level of development in both dimensions. The final scoring is calculated through the weighted average of the score given to a series of key performance indicators depending on how strong they are. In the case of the ‘technology’ dimension, the calculation includes: GitHub Code Activity (Stars, forks, Commits, Contributors, Pull requests, Issues Tracking); Code Test Coverage; Open Source License Status; User Testing #; Prototype Readiness. In the case of the ‘business sustainability’ dimension, the calculation includes: Revenue, Expenses; Profit Margin; Number of Users and User Growth; Amount of funding received and number of third party funders (aside from them and UNICEF); Team sustainability (including tech and business skills as well as gender diversity).
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/chaoss_fund.pdf
-----
Cecilia Chapiro
Investment Adviser & Blockchain Portfolio Manager - UNICEF
@ceciliachapiro
Cecilia is the investment adviser for the UNICEF Innovation Fund where she leads the sourcing and selection process of open source and frontier tech start-ups in developing and emerging countries. She also manages the blockchain portfolio of investments and developed the measurement model to track the progress of all companies in our portfolio (including extended reality, IoT, drones, blockchain, data science and AI).
Before UNICEF, she founded Yunus & Youth, supported by Nobel Peace Prize recipient Muhammad Yunus where she has helped grow social businesses in more than 40 countries. Cecilia has eight years of work experience in the for-profit sector (Johnson & Johnson), the non-profit sector (Junior Achievement, Ashoka, AIESEC, ‘Techo’), and the international field (Organization of American States, Grameen).
Originally from Argentina, Cecilia has lived and worked in Australia, Bangladesh, Brazil, England, Germany, Spain and USA. She holds a Licentiate in Business Administration from ‘Universidad de San Andres’ and a Master’s in Public Administration from NYU where was a founding member of the first NYU student led Impact Investment Fund and she attended as a Fulbright Scholar.
Justin W. Flory
Open Source Contributor
@jflory7
Justin W. Flory is a creative maker. He is best-known as an open source contributor based in the United States. Since 2018, Justin is a leading member of the LibreCorps program of the FOSS@MAGIC initiative at the Rochester Institute of Technology. He was the first, full-time co-op placement to work exclusively on community issues for UNICEF Office of Innovation. This was work he did in concert with UNICEF personnel and Red Hat Open Innovations Lab on UNICEF’s MagicBox effort. Since then, Justin led workshops for UNICEF’s Innovation Fund to introduce over 20 international start-up teams to the Open Source way. Currently, he works as a consultant for open source projects and community-building. Using Justin’s initial efforts with MagicBox as a starting point, RIT’s current LibreCorps mentors build interactive resources for clients.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 4 participants
- 15 minutes
23 Feb 2020
Language barriers for open source contributors
While open source development is common across the world, projects from countries outside North America and Europe, such as China, have difficulties attracting international contributors. One major reason for this is language differences. Thus, there is a lack of understanding of whether there are problems with attraction and retention of contributors due to language differences. To address the aforementioned issue, the proposed presentation will provide an overview of the diversity of non-native English speakers in different open source ecosystems. Furthermore, we will provide results about whether or not those contributors face a language barrier when contributing to open source projects. This will include a survey and a discussion with the audience to understand their motivations when contributing to open source projects, if they have ever faced any communication problems due to language differences, if the non-native English speakers feel welcomed in open source communities, and if they have ever felt that there is a language barrier when contributing to open source projects. The presentation will conclude with a discussion on how we can create metrics to assess the spoken language diversity in open source communities and how to include those people in the community more easily.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/language_barriers.pdf
-----
Isabella Vieira Ferreira
PhD Student - Polytechnique Montréal
@isaferreira_57
Isabella Ferreira is currently a PhD student at Polytechnique Montréal working under the supervision of Dr. Bram Adams. As part of her degree, she is working with cross-cultural contributions in open source projects, civil communication in open source projects, and on how to link review e-mails to Git commits. Her main research interests are mining software repositories, software maintenance and evolution, and human affect in Software Engineering.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
While open source development is common across the world, projects from countries outside North America and Europe, such as China, have difficulties attracting international contributors. One major reason for this is language differences. Thus, there is a lack of understanding of whether there are problems with attraction and retention of contributors due to language differences. To address the aforementioned issue, the proposed presentation will provide an overview of the diversity of non-native English speakers in different open source ecosystems. Furthermore, we will provide results about whether or not those contributors face a language barrier when contributing to open source projects. This will include a survey and a discussion with the audience to understand their motivations when contributing to open source projects, if they have ever faced any communication problems due to language differences, if the non-native English speakers feel welcomed in open source communities, and if they have ever felt that there is a language barrier when contributing to open source projects. The presentation will conclude with a discussion on how we can create metrics to assess the spoken language diversity in open source communities and how to include those people in the community more easily.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/language_barriers.pdf
-----
Isabella Vieira Ferreira
PhD Student - Polytechnique Montréal
@isaferreira_57
Isabella Ferreira is currently a PhD student at Polytechnique Montréal working under the supervision of Dr. Bram Adams. As part of her degree, she is working with cross-cultural contributions in open source projects, civil communication in open source projects, and on how to link review e-mails to Git commits. Her main research interests are mining software repositories, software maintenance and evolution, and human affect in Software Engineering.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 5 participants
- 19 minutes
23 Feb 2020
Managing community backlog with the help of metrics
One of the ways you can measure responsiveness to community contribution is by looking at the size of the backlog periodically. If the backlog of community contribution keeps growing without contributions being closed/merged in a timely manner, this will lead to dissatisfaction among community members. In this talk, Ray will discuss why “Community contribution” Merge Request (MR) backlog has become important at GitLab and how he worked with Alberto at Bitergia to develop visualizations for MR backlogs across GitLab projects. Alberto will discuss why current GrimoireLab dashboards needed to evolve to support GitLab’s use case (beyond GrimoireLab’s existing backlog focused dashboards), technical challenges and limitations when developing the visualization (e.g. calculating the number of contributions that were in opened state on the fly within a given time range that can be selected by the user), and plans for upstreaming this work to CHAOSS.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/Managingbacklogs.pdf
-----
Ray Paik
Community Manager - GitLab
@rspaik
Ray is a Community Manager at GitLab where he is helping to grow the community of contributors to GitLab. Prior to GitLab, Ray was responsible for the day-to-day operation of the Open Platform for NFV (OPNFV) community since its launch in 2014. He has over 15 years of experience in the high-tech industry in roles ranging from software engineer, product manager, program manager, account manager, and team lead at companies such as EDS, Intel, Linux Foundation, and Medallia. Ray lives in Sunnyvale, CA with his wife and daughter and all three are loyal season ticket holders of the San Jose Earthquakes soccer team.
Alberto Pérez García-Plaza
Software Engineer - Bitergia
@alpgarcia
Alberto Pérez García-Plaza is currently working as part of support and consulting teams at Bitergia. He is involved in helping customers to deal with data and compute metrics on top of them. He has over 10 years of experience working with data in fields from automatic document organization to cyber security intelligence tasks. He has also a Ph.D. in Artificial Intelligence related to web page representation by means of fuzzy logic oriented to clustering tasks.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
One of the ways you can measure responsiveness to community contribution is by looking at the size of the backlog periodically. If the backlog of community contribution keeps growing without contributions being closed/merged in a timely manner, this will lead to dissatisfaction among community members. In this talk, Ray will discuss why “Community contribution” Merge Request (MR) backlog has become important at GitLab and how he worked with Alberto at Bitergia to develop visualizations for MR backlogs across GitLab projects. Alberto will discuss why current GrimoireLab dashboards needed to evolve to support GitLab’s use case (beyond GrimoireLab’s existing backlog focused dashboards), technical challenges and limitations when developing the visualization (e.g. calculating the number of contributions that were in opened state on the fly within a given time range that can be selected by the user), and plans for upstreaming this work to CHAOSS.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/Managingbacklogs.pdf
-----
Ray Paik
Community Manager - GitLab
@rspaik
Ray is a Community Manager at GitLab where he is helping to grow the community of contributors to GitLab. Prior to GitLab, Ray was responsible for the day-to-day operation of the Open Platform for NFV (OPNFV) community since its launch in 2014. He has over 15 years of experience in the high-tech industry in roles ranging from software engineer, product manager, program manager, account manager, and team lead at companies such as EDS, Intel, Linux Foundation, and Medallia. Ray lives in Sunnyvale, CA with his wife and daughter and all three are loyal season ticket holders of the San Jose Earthquakes soccer team.
Alberto Pérez García-Plaza
Software Engineer - Bitergia
@alpgarcia
Alberto Pérez García-Plaza is currently working as part of support and consulting teams at Bitergia. He is involved in helping customers to deal with data and compute metrics on top of them. He has over 10 years of experience working with data in fields from automatic document organization to cyber security intelligence tasks. He has also a Ph.D. in Artificial Intelligence related to web page representation by means of fuzzy logic oriented to clustering tasks.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 2 participants
- 17 minutes
23 Feb 2020
Measuring Culture
They say you can’t be certain of anything unless it can be measured – so what about culture? We know it exists and can be passed on to others, so there must be a way to measure it. Using Apache Kibble we attempt to look for cultural indicators at the Apache Software Foundation, set a cultural benchmark then match real Apache projects against it. In theory we would expect a perfect match but as the results show, culture isn’t that simple.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/Measuring-Culture.pdf
-----
Sharan Foga
VP Apache Community Development - The Apache Software Foundation
Sharan Foga has over 20 years in the IT industry working on the delivery and implementation of IT projects. She is currently based in Stockholm, Sweden and works for Sandvik as an Agile Delivery Manager. She has been involved with the Apache Software Foundation (ASF) since 2008 and has presented at several conferences about ""The Apache Way"" of engaging and empowering communities. She enjoys working on open source community management and is VP Apache Community Development. She is a Committer, ASF Member and is involved in several ASF projects including Apache Community Development, Apache OFBiz, Apache Kibble, Apache Training (incubating) and Apache Incubator.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
They say you can’t be certain of anything unless it can be measured – so what about culture? We know it exists and can be passed on to others, so there must be a way to measure it. Using Apache Kibble we attempt to look for cultural indicators at the Apache Software Foundation, set a cultural benchmark then match real Apache projects against it. In theory we would expect a perfect match but as the results show, culture isn’t that simple.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/Measuring-Culture.pdf
-----
Sharan Foga
VP Apache Community Development - The Apache Software Foundation
Sharan Foga has over 20 years in the IT industry working on the delivery and implementation of IT projects. She is currently based in Stockholm, Sweden and works for Sandvik as an Agile Delivery Manager. She has been involved with the Apache Software Foundation (ASF) since 2008 and has presented at several conferences about ""The Apache Way"" of engaging and empowering communities. She enjoys working on open source community management and is VP Apache Community Development. She is a Committer, ASF Member and is involved in several ASF projects including Apache Community Development, Apache OFBiz, Apache Kibble, Apache Training (incubating) and Apache Incubator.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 3 participants
- 19 minutes
23 Feb 2020
Metrics and valuation of open source projects: A crossover between Open Source and Open Science
Despite the evolution of the legal context (at European and national levels) to acknowledge and leverage the benefits of Open Source, Open Data and Open Science - especially in regards to innovation - the most commonly used metrics to evaluate the potential and the success of projects are still tied to old & closed Intellectual Property practices (number of patents, direct financial streams from proprietary licencing, etc.). There is a need for metrics more suited to fairly arbitrate between an open or a closed model and also to more efficiently manage open projects’ valorisation. This session will present our explorations for a methodology to reflect the value generated by Open Source projects in the field of public research. We will build on our work in an open working group dedicated to the valuation of open intangible assets and studies we have conducted for public institutions, including the French Space Agency (CNES). It will cover theoretical questions like the definition of value in a given context as well as down-to-earth implementation-specific problems, like choosing micro-metrics for code contribution. The presentation will also highlight how current research in academia on the evaluation of open science (good citation practices, tracability and reproducibility) can be a source of inspiration for further work in open source communities.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/metrics_valuation.pdf
-----
Camille Moulin
Consultant - Inno³
@Camille
Camille has been an Open Source and Open Standards advocate for quite a few years now; he is currently working as a consultant at Inno³, a French niche consultancy specialized in all things Open from an IP & organisational point of view.
Celya Gruson-Daniel
Consultant - Inno³
@celyagd
As a consultant at Inno³, Célya Gruson-Daniel helps various private and public institutes in opening up research and innovation by promoting the implementation of open science and data science practices and the co-construction of knowledge (science/society interactions). With a PhD in social sciences, she frequently lectures in various research and higher education institutes to provide training in digital methodologies (data collection, analysis and management) using a pragmatic and participatory approach. She co-founded the HackYourPhD community to create a space for sharing and exchange on the evolution of research practices. She also undertakes various missions of project management and communication strategy using co-design methodologies. She gives particular attention to the development of collective dynamics and governance respectful of individuals and organizations to build sustainable digital societies.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
Despite the evolution of the legal context (at European and national levels) to acknowledge and leverage the benefits of Open Source, Open Data and Open Science - especially in regards to innovation - the most commonly used metrics to evaluate the potential and the success of projects are still tied to old & closed Intellectual Property practices (number of patents, direct financial streams from proprietary licencing, etc.). There is a need for metrics more suited to fairly arbitrate between an open or a closed model and also to more efficiently manage open projects’ valorisation. This session will present our explorations for a methodology to reflect the value generated by Open Source projects in the field of public research. We will build on our work in an open working group dedicated to the valuation of open intangible assets and studies we have conducted for public institutions, including the French Space Agency (CNES). It will cover theoretical questions like the definition of value in a given context as well as down-to-earth implementation-specific problems, like choosing micro-metrics for code contribution. The presentation will also highlight how current research in academia on the evaluation of open science (good citation practices, tracability and reproducibility) can be a source of inspiration for further work in open source communities.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/metrics_valuation.pdf
-----
Camille Moulin
Consultant - Inno³
@Camille
Camille has been an Open Source and Open Standards advocate for quite a few years now; he is currently working as a consultant at Inno³, a French niche consultancy specialized in all things Open from an IP & organisational point of view.
Celya Gruson-Daniel
Consultant - Inno³
@celyagd
As a consultant at Inno³, Célya Gruson-Daniel helps various private and public institutes in opening up research and innovation by promoting the implementation of open science and data science practices and the co-construction of knowledge (science/society interactions). With a PhD in social sciences, she frequently lectures in various research and higher education institutes to provide training in digital methodologies (data collection, analysis and management) using a pragmatic and participatory approach. She co-founded the HackYourPhD community to create a space for sharing and exchange on the evolution of research practices. She also undertakes various missions of project management and communication strategy using co-design methodologies. She gives particular attention to the development of collective dynamics and governance respectful of individuals and organizations to build sustainable digital societies.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 2 participants
- 19 minutes
23 Feb 2020
Metrics are more than the sum of their parts
There was a time in human history when it was believed that all of human behavior could be explained with math. That widely acclaimed and highly respected science was disproved by an “incompleteness theorem” that showed math cannot explain the world on its own. In another time in human history, psychologists believed all human behavior could be reduced to cause and effect. This gave rise to Gestalt theory that shows perception is not always mapped cleanly or with certainty. We are in a state of Community building that maps success to metrics like lines of code and GitHub stars. I would like us to explore where these metrics fall short on capturing the most significant value of a community, and how we can use other metrics to begin to show the much larger impact Community organizations like Developer Relations (DevRel) can have on a business. This improved process begins with mapping value to business need, pairing it with a community need, and back to the business opportunities. If you enjoy a little science, a lot of community metrics, and are looking for new ways to show a business the value of your community efforts, this talk is for you. There will be practical advice on how to pitch and position Community whether you’re a Community Manager, Developer Advocate, or other Developer Relations professional.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/MattBroberg.pdf
-----
Matt Broberg
Technical Advocate & Editor - Opensource.com
@mbbroberg
Matt is an advocate for open source software and currently the Technical Editor of Opensource.com. He specializes in designing technology communities that develop products and content in a way that tells a powerful story.
Matt was an EMC storage expert, VMware vExpert, and former fan of other proprietary technologies. He now focuses on open source and DevRel adoption. He is a serial podcaster, best known for the Geek Whisperers podcast, co-built the DevRel Collective, and often shares on Twitter and GitHub @mbbroberg. He’s also a fan of tattoos and cats, though he remains unsure of Schrödinger’s.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
There was a time in human history when it was believed that all of human behavior could be explained with math. That widely acclaimed and highly respected science was disproved by an “incompleteness theorem” that showed math cannot explain the world on its own. In another time in human history, psychologists believed all human behavior could be reduced to cause and effect. This gave rise to Gestalt theory that shows perception is not always mapped cleanly or with certainty. We are in a state of Community building that maps success to metrics like lines of code and GitHub stars. I would like us to explore where these metrics fall short on capturing the most significant value of a community, and how we can use other metrics to begin to show the much larger impact Community organizations like Developer Relations (DevRel) can have on a business. This improved process begins with mapping value to business need, pairing it with a community need, and back to the business opportunities. If you enjoy a little science, a lot of community metrics, and are looking for new ways to show a business the value of your community efforts, this talk is for you. There will be practical advice on how to pitch and position Community whether you’re a Community Manager, Developer Advocate, or other Developer Relations professional.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/MattBroberg.pdf
-----
Matt Broberg
Technical Advocate & Editor - Opensource.com
@mbbroberg
Matt is an advocate for open source software and currently the Technical Editor of Opensource.com. He specializes in designing technology communities that develop products and content in a way that tells a powerful story.
Matt was an EMC storage expert, VMware vExpert, and former fan of other proprietary technologies. He now focuses on open source and DevRel adoption. He is a serial podcaster, best known for the Geek Whisperers podcast, co-built the DevRel Collective, and often shares on Twitter and GitHub @mbbroberg. He’s also a fan of tattoos and cats, though he remains unsure of Schrödinger’s.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 1 participant
- 19 minutes
23 Feb 2020
Navigating Community Health Through Comparison
In this presentation, we share stories from 30 plus interviews on community health and offer our insights from engagement with the CHAOSS project. In particular, we focus on how people use comparisons in the determination of project health. To make solutions actionable, placing open source project metrics into the specific contexts where they are consumed is critical. When open source project contributors compare one open source project to another, they get a sense of how they are doing, relatively speaking. The comparison is social insofar as people draw comparisons between projects that are similar in terms of personnel or other key characteristics; projects they are socially familiar with. Through comparison, open source project contributors identify metrics that draw essential contrasts, and through these contrasts evaluate the likelihood of continued success or failure for their projects of interest.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/navigating_health_sc.pdf
-----
Kevin Lumbard
Doctoral Student Researcher - University of Nebraska at Omaha
@Paper_Monkeys
Kevin is a doctoral student at the University of Nebraska at Omaha. Kevin is an active participant in the CHAOSS community. His research is concerned with collaborative design and community health metrics.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
In this presentation, we share stories from 30 plus interviews on community health and offer our insights from engagement with the CHAOSS project. In particular, we focus on how people use comparisons in the determination of project health. To make solutions actionable, placing open source project metrics into the specific contexts where they are consumed is critical. When open source project contributors compare one open source project to another, they get a sense of how they are doing, relatively speaking. The comparison is social insofar as people draw comparisons between projects that are similar in terms of personnel or other key characteristics; projects they are socially familiar with. Through comparison, open source project contributors identify metrics that draw essential contrasts, and through these contrasts evaluate the likelihood of continued success or failure for their projects of interest.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/navigating_health_sc.pdf
-----
Kevin Lumbard
Doctoral Student Researcher - University of Nebraska at Omaha
@Paper_Monkeys
Kevin is a doctoral student at the University of Nebraska at Omaha. Kevin is an active participant in the CHAOSS community. His research is concerned with collaborative design and community health metrics.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 2 participants
- 10 minutes
23 Feb 2020
Open and Reproducible Research with Community-driven Research Software Metrics
What do artificial neural networks, images of the black hole, and SETI@home all have in common? They all trace their roots to research software. In this session, we hope to explore metrics and best practices for evaluating open research software. Research software engineers are evaluated largely based on the numbers of publications and citations. However, metrics based on the number of publications encourage re-creating ‘new’ things or reimplementations instead of reuse, and there are huge variations in existing practices to cite software, meaning software isn't always cited or citations aren’t always captured. Better metrics that reflect the health of research software is crucial to avoid gamification, incentivising research software engineers to follow best software development practices by recognising and rewarding their effort appropriately, and ultimately advancing open science and improving the reproducibility of research.
Through engaging the audience in a discussion to compare research software and other FOSS, we hope to better connect the research software community to the wider FOSS community. By learning from each other, we aim to identify evaluation metrics that accurately reflect research software health and can be used by hiring committees and research funders, to encourage them to move away from current problematic metrics. Ultimately, we hope this will incentivise the creation and maintenance of good quality scientific open software.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/open_reproducible_research.pdf
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
What do artificial neural networks, images of the black hole, and SETI@home all have in common? They all trace their roots to research software. In this session, we hope to explore metrics and best practices for evaluating open research software. Research software engineers are evaluated largely based on the numbers of publications and citations. However, metrics based on the number of publications encourage re-creating ‘new’ things or reimplementations instead of reuse, and there are huge variations in existing practices to cite software, meaning software isn't always cited or citations aren’t always captured. Better metrics that reflect the health of research software is crucial to avoid gamification, incentivising research software engineers to follow best software development practices by recognising and rewarding their effort appropriately, and ultimately advancing open science and improving the reproducibility of research.
Through engaging the audience in a discussion to compare research software and other FOSS, we hope to better connect the research software community to the wider FOSS community. By learning from each other, we aim to identify evaluation metrics that accurately reflect research software health and can be used by hiring committees and research funders, to encourage them to move away from current problematic metrics. Ultimately, we hope this will incentivise the creation and maintenance of good quality scientific open software.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/open_reproducible_research.pdf
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 5 participants
- 14 minutes
23 Feb 2020
Technical Lag: Measuring the outdatedness, vulnerability and bugginess of software
This talk presents a generic and empirically validated measurement framework based on the technical lag concept. The framework can be used to assess and reduce the outdatedness, vulnerability and bugginess of software deployments, software projects, software containers and reusable software libraries. We argue that such a metric is very relevant for assessing the health of software (eco)systems, and should become part of the CHAOSS metrics portfolio and tooling. The concept of technical lag aims to quantify to which extent a deployed collection of components is outdated with respect to an ideal deployment. How to interpret this ""ideal"" and the ""outdatedness"" w.r.t. this ""ideal"" is highly context-specific. Depending on the needs and goals of a specific project or a maintainer, the focus may be on functionality, security, stability or even other factors. The ""components"" under consideration could be individual software packages, third-party libraries, component dependencies, or software containers bundling collections of components. To cover this high variability, we have come up with a generic framework for technical lag. We have operationalised and empirically validated this framework in different contexts: to assess the technical lag incurred by outdated dependencies in reusable package repositories such as npm; and to quantify the outdatedness of Debian-based Docker containers in terms of missing updates, vulnerabilities and bugs. We also report on the qualitative evaluation of the usefulness of measuring technical lag, through online surveys conducted with open source software developers. Finally, we present Conpan, an open source tool that we have developed for analysing technical lag in Docker containers. Useful references about technical lag are available on https://secoassist.github.io/results.html
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/techlag.pdf
-----
Tom Mens
Professor in Software Engineering - University of Mons, Belgium
@tom_mens
Ahmed Zerouali
Postdoc in Software Engineering - University of Mons, Belgium
@a_zerou
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
This talk presents a generic and empirically validated measurement framework based on the technical lag concept. The framework can be used to assess and reduce the outdatedness, vulnerability and bugginess of software deployments, software projects, software containers and reusable software libraries. We argue that such a metric is very relevant for assessing the health of software (eco)systems, and should become part of the CHAOSS metrics portfolio and tooling. The concept of technical lag aims to quantify to which extent a deployed collection of components is outdated with respect to an ideal deployment. How to interpret this ""ideal"" and the ""outdatedness"" w.r.t. this ""ideal"" is highly context-specific. Depending on the needs and goals of a specific project or a maintainer, the focus may be on functionality, security, stability or even other factors. The ""components"" under consideration could be individual software packages, third-party libraries, component dependencies, or software containers bundling collections of components. To cover this high variability, we have come up with a generic framework for technical lag. We have operationalised and empirically validated this framework in different contexts: to assess the technical lag incurred by outdated dependencies in reusable package repositories such as npm; and to quantify the outdatedness of Debian-based Docker containers in terms of missing updates, vulnerabilities and bugs. We also report on the qualitative evaluation of the usefulness of measuring technical lag, through online surveys conducted with open source software developers. Finally, we present Conpan, an open source tool that we have developed for analysing technical lag in Docker containers. Useful references about technical lag are available on https://secoassist.github.io/results.html
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/techlag.pdf
-----
Tom Mens
Professor in Software Engineering - University of Mons, Belgium
@tom_mens
Ahmed Zerouali
Postdoc in Software Engineering - University of Mons, Belgium
@a_zerou
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 2 participants
- 17 minutes
23 Feb 2020
True Confessions: The Seven Deadly Sins of Open Source Communities
This talk would take a humorous approach to explaining what really no one should do when managing and measuring open source community best practices, with the primary goal of instilling positive open source development practices to the audience. Such ""don'ts"" include not documenting anything, establishing no clear paths to success, and not bothering to communicate.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/seven_deadly_sins.pdf
-----
Brian Proffitt
Manager - Red Hat Open Source Program Office
@TheTechScribe
Brian is a Manager within the Red Hat Open Source Program Office, active in community content, onboarding, and open source consulting. Brian also serves on the governing board for Project CHAOSS, a metrics-oriented approach to ascertaining community health. Follow him on Twitter @TheTechScribe.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
This talk would take a humorous approach to explaining what really no one should do when managing and measuring open source community best practices, with the primary goal of instilling positive open source development practices to the audience. Such ""don'ts"" include not documenting anything, establishing no clear paths to success, and not bothering to communicate.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/seven_deadly_sins.pdf
-----
Brian Proffitt
Manager - Red Hat Open Source Program Office
@TheTechScribe
Brian is a Manager within the Red Hat Open Source Program Office, active in community content, onboarding, and open source consulting. Brian also serves on the governing board for Project CHAOSS, a metrics-oriented approach to ascertaining community health. Follow him on Twitter @TheTechScribe.
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 3 participants
- 18 minutes
22 Feb 2020
Session: Heat, Light, and Love: Telling Twitter's Open Source Program Office's Story
Making it simple to trust, ship, and grow open source at Twitter demanded visibility into contribution trends that were not readily available. Twitter's open source program office and the Augur project collaborated with CHAOSS using student interns from Google's Summer of Code, Twitter's intern program and the University of Missouri. First, this talk will describe Twitter's engaging interface design and its fit to the needs of Open Source stakeholders within Twitter, but outside the open source program office. Second, we will describe how an open API and data collection tool, Augur, evolved in close collaboration with Twitter.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/heat_light_love.pdf
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
Making it simple to trust, ship, and grow open source at Twitter demanded visibility into contribution trends that were not readily available. Twitter's open source program office and the Augur project collaborated with CHAOSS using student interns from Google's Summer of Code, Twitter's intern program and the University of Missouri. First, this talk will describe Twitter's engaging interface design and its fit to the needs of Open Source stakeholders within Twitter, but outside the open source program office. Second, we will describe how an open API and data collection tool, Augur, evolved in close collaboration with Twitter.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/heat_light_love.pdf
-----
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 3 participants
- 20 minutes
22 Feb 2020
Keynote: Ethics: What You Know & What You Don't Know
Metrics give us a lot of insight into what's going on with our projects -- but only if we have enough context. The catch is that personal biases and pre-conceptions are extremely hard to filter for so no one person can see everything. Those gaps means that even the most well-meaning of us could end up doing more harm than good. In this talk, I'll share a few examples of the ways human brains make assumptions, some of our typical blind spots and how incomplete data can cause harm when deployed without any checks. For folks who collect, analyze and ultimately make mission critical decisions with metrics, the challenge is to constantly maintain a bit of healthy skepticism of what the numbers seem to be telling us.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/ethics.pdf
-------
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
Metrics give us a lot of insight into what's going on with our projects -- but only if we have enough context. The catch is that personal biases and pre-conceptions are extremely hard to filter for so no one person can see everything. Those gaps means that even the most well-meaning of us could end up doing more harm than good. In this talk, I'll share a few examples of the ways human brains make assumptions, some of our typical blind spots and how incomplete data can cause harm when deployed without any checks. For folks who collect, analyze and ultimately make mission critical decisions with metrics, the challenge is to constantly maintain a bit of healthy skepticism of what the numbers seem to be telling us.
Slides: https://chaoss.github.io/website/CHAOSScon/2020EU/slides/ethics.pdf
-------
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 3 participants
- 31 minutes
22 Feb 2020
About CHAOSScon
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
Learn about open source project health metrics and tools used by open source projects, communities, and engineering teams to track and analyze their community work. This conference will provide a venue for discussing open source project health, CHAOSS updates, use cases, and hands-on workshops for developers, community managers, project managers, and anyone interested in measuring open source project health. We will also share insights from the CHAOSS working groups on Diversity and Inclusion, Evolution, Risk, Value, and Common Metrics.
https://chaoss.community/chaosscon-2020-eu/
- 1 participant
- 15 minutes
