►
From YouTube: CHAOSS Metrics Models Working Group Feb 14-15, 2023
Description
Minutes from this meeting can be found here: https://docs.google.com/document/d/1qE2duE73NbEOHzRRAbqgPSUSAfdH-AmvLruOu7uCIYg/edit
A
Hi
everybody
Welcome
to
the
February
14th
15th
chaos,
metrics
model
meeting,
it's
good
to
see
everybody
I
am
going
to
share
my
screen
and
the
minutes
are
in
the
chat,
Elizabeth
or
Sean.
If
somebody
else
shows
up,
can
you
just
drop
them
in
there
yeah
for
other
folks?
If
you
could
add
your
name,
that
would
be
great.
A
I
was
talking
briefly
with
yahui
about
a
potential
time
change
for
this
and
It's
Only.
Just
to
help
everybody
so
I
know
that
it's
quite
early
in
China
and
it
gets
to
be
fairly
like
it's
seven
o'clock
in
the
evening
for
Elizabeth,
so
the
The
Proposal
would
be
to
to
just
shift
it
to
8
A.M,
U.S,
Central
or
even
7
A.M
U.S
Central
could
work
yeah.
C
D
But
I
I
like
this
proposal
because
right
now
is
still
the
winter
time
time
for
for
ui's
Central.
So
maybe
next
months
or
later
it's
should
it
still
be
in
the
summertime
spring
and
they
have
to
wake
up
so
in
China
or
meeting
will
be
holding
seven
and
am
clock.
So
it's
counter
it's
kind
of
early
for
us
because
for
me,
I
have
to
take
the
tax
rate
to
take
taxi
to
to
the
company
and
then
the
meeting.
B
A
A
C
Do
have
the
badging
meeting.
D
A
D
A
A
B
A
We'll
send
out
the
updates
for
everybody
all
right.
So
then
the
next
thing
I
wanted
to
to
kind
of
do
is
I.
Do
want
to
spend
a
little
bit
of
time
on
this
just
to
thank
Elizabeth
for
all
of
her
work,
yeah
and
getting
this
all
done.
A
So
for
those
of
you
that
didn't
know
like
two
weeks
ago,
I
think
we
had
one
metric
model
released.
Is
that
correct
Elizabeth?
Yes,.
C
A
A
C
Because
a
review
is
required
to
merge
somebody
had
to
review
so
sorry,
everybody.
E
C
Yeah
so
we've
been
trying
to
when
we
reference
other
metrics,
keep
that
the
URL
yeah
with
the
number,
because
we
do
change
the
names
of
metrics
sometimes,
and
so
we
don't
want
that
link
to
break
so
we've
decided
to
try
to
keep
it
if
we're
referencing
things
across.
You
know
each
other
and
we're
also
going
to
put
at
the
bottom
of
every
metric.
C
C
That's
a
question
we
absolutely
could
I
think
we
should
because,
as
we
know,
metrics
model
names
change
as
we
already
changed
ones.
So
yeah
I
can
add
that
that
statement
at
the
bottom.
That
says,
if
you're
referencing,
this
metrics
model
use
this
URL.
That.
E
E
A
G
Sorry
can
anyone
share
the
minutes
because
I
have
the.
B
C
C
A
C
C
I
believe
well,
so,
yes,
so
context.
Actually
this
is
my
question.
I
should
have
asked
Kevin
this,
so
the
context
tags
is
really
the
topics.
So
if
you
go
back
to
just
like
the
yeah,
so
if
you
go
back
to
the
metrics
and
model
yeah
and
then
you
click
on
a
topic
that
metric
model
should
show
up
there
metric.
E
G
Can
you
hear
me
there
is
a
suggestion
I
have
if
you
go
back
to
the
metric
again
like
the
that
one,
the
model,
sorry,
the
Magic
model.
G
G
D
A
Idea:
okay,
maybe
like
let's
maybe
first
thing:
let's
get
the
static
URL
on
there.
Maybe
the
next
thing
would
be
to
like
slowly
but
surely
make
sure
the
keywords
are
in
the
right
place
in
WordPress.
A
F
A
Like
if
I
was
to
come
here,.
F
A
So
we
should
Elizabeth
I
can
help
with
this
too,
but
like
for
those
that
have.
C
I,
have
guinea
pigs
squealing
in
the
back
over
there,
but
yeah,
so
we
can
add
that
that's
a
great
idea,
June
and
then,
as
those
become
available,
do
you
all
want
to
just
open
an
issue
or
tag
me
somewhere
that
hey
there's
a
new
implementation
that
needs
to
be
added
or
how
do
we
want
to
make
that
bridge.
G
How
about
how
about
in
that
model
page
we
have
an
implementation
section
if
it
is
implemented,
yeah
link
to
that
implementation
or
it
implementation
once
it's
done
or
we
can
have
some
text
that
says
implementation
is
not
done
yet.
Once
it's
done
we'll
add
the
link
over
here.
D
D
Discussed
it
a
little
bit
before
and
we
can
add
one
more
section
in
each
of
single
matrix
model
about
the
implementations
and
in
this
implementation
we
can
add
more
tools
or
platform
to
support
this
matrix
model
implementations,
and
we
can
touch
the
link
for,
for
example,
auger,
grimlab,
okay
or
Compass
yeah.
We
can.
We
can
touch
this
valid
link
and
also,
if
we
don't
have
it
yet,
like
we
not
mentioned
we
can
leave
it.
I
mean
anti.
Yes,.
D
Or
do
you
want
it,
maybe
after
maybe
before
before
the
Implement,
before
the
Data
Insights
yeah.
D
A
B
A
A
A
You
all
right,
great,
okay,
so
I'm
gonna
move
on.
If
that's
okay
with
people,
it
is.
C
F
A
Right:
okay,.
F
D
B
I
think
I
think
we
yeah
I,
guess
I
and
Emma
and
Lucas
yahui.
Look
at
that.
Okay,
you
know
who
put
this
stuff
together.
This
is
unwieldy,
but
look
look,
look,
look.
D
B
C
A
B
A
A
Spreadsheets
are
amazing:
aren't
they
great
okay
cool
now
I'll
move
on
okay,
so
I,
just
I
wanted
to
just
ask
the
compass
team
I
know
that
you
have
been
doing
some
Metric
model
validation,
work
I
just
wanted
to
allow
you
an
opportunity
to
speak
to
that.
If
you
wanted
to
no
big
deal.
D
I
I
wanna,
put
to
one
matrix
model
proposed
to
buy
dollars,
yeah
I'm
waiting
for
that
matrix
model
be
released
or,
and
the
creative
issue
in
compass
and
I
can
I
can
trigger
the
following
implementation
in
complex
I.
A
Think,
yeah
and
I
think
Don
just
finished
up
her
comments
today.
I
think
she
had
some
formatting
questions
that
Kevin
answered
so
I
think
we're
good
there.
So,
okay,
oh
probably
first
thing
tomorrow
morning,
I'll
send
that
over.
If
that
works,
for
you
yeah.
D
A
Sounds
good
starter,
okay,.
D
And
do
you
remember
that,
like
last
year
or
two,
we
may
know
like
like
two
years
ago,
almost
really
when
we
first
set
our
metrics
model
working
group,
we
are
talking
about
how
to
categories
of
the
metrics
different
metrics
into
the
different
metrics
model
and
and
actually
in
our
matrix
model.
We
live.
We
think
of
that.
So
we're
gonna
provide
the
different
alternate
metrics
in
the
matrix
model
and
let
more
people
to
select
the
different
one.
D
D
A
Would
it
be,
it
sounds
interesting
so
like?
Would
it
be
giving
them,
for
example,
this
metrics
model,
and
they
can
pick
whatever
metrics
they.
E
D
I
and
you
know,
for
the
one
matrix
model,
except
for
we
selected,
multiple
metrics
and
also
we
need
to
aggregate
thing
into
the
one
matrix
model
you.
D
The
final
score,
but
we
would
provide
a
flexible
way
for
that,
for
example,
we
provide
some.
You
know
some
Autobox
algorithm
for
to
to
calculate
the
final
score,
but
if
you
want
to
apply
a
new
algorithm
for
that
matrix
model,
you
can
you
can
tell
us
we
can
help
you
to
implement
it.
That's.
A
Yeah,
so
you
could
try
like
one
that
we
have
prepared
or
you
could
help
prepare
your
own
and
I.
Think
that'd
be
really
interesting,
because
it
would
be
kind
of
another
way
to
identify
metrics
models
by
just
watching
use
processes
like
we
would
just
kind
of
watch
what
people
bring
together
consistently.
D
I
mean
after
after
this
monks,
maybe
next
month
or
next
month
earlier
in
the
compass,
we
would
provide
more
than
twenty
thousand
projects,
mostly
on
the
GitHub.
It's
ready
on
the
compass
and
we
have
to.
We
have
already
categorized
thing
into
the
into
16
categorized
and
you
can
select.
You
can
pick
up
some
some
specific
Zoom
to
try
on
your
your
own
matrix
model,
yeah.
D
A
It
would
be
what
it
would
be
interesting,
at
least
if
I'm
understanding
that's
right
is
if,
if
people
consistently
bring
together
like
age
of
pull,
request
response
time
issue
commit
like
it's
kind
of
four
random,
what
we
would
think
of
as
random
things,
but
people
bring
those
four
together
consistently
I
think
it
would
make
us
kind
of
reflect
on.
Why
are
people
bringing
these
four
metrics
together
consistently
and
it's.
G
A
B
A
A
That
sounds
great
when
that's
when
that's
ready,
I'd
love
to
see
it,
yep
cool,
okay,
great
some
moving
on
a
couple
things
here,
so
you
know
I
think
I
feel
like
with
Elizabeth
you
kind
of
doing
that
release
and
now
that
we
have
safety
all
good
to
go.
It's
like
all
purples
are
now.
You
know
basically
released,
so
we
can
actually
update
that.
So
the
the
next
question
I
think
for
us
is:
where
do
we
want
to
focus
next?
You
know
what
are
the
metrics
models
that
are
interesting
to
us
and.
A
That
are
already
kind
of
moving
along.
Interestingly,
it's
always
funny
to
me.
I
give
the
example
of
community
welcomingness
as
a
metric
model,
often
and
it's
one-
that's
not
released
so
personally,
I
would
like
to
work
on
community
welcomingness
and
we
do
have
it's
fairly
well,
along
and
I
thought.
Maybe
we
could
take
a
little
look
at
this
for
a
second
and
then
the
other
one
is:
is
community
fatigue
which
I
don't
talk
about
much
but
I?
A
Think
it's
a
fairly
interesting
metric
model
and
would
resonate
with
a
number
of
people,
so
the
question
I
have
maybe
on
community
welcomingness
is
generally
speaking,
we
like
to
keep
our
metrics
models
smaller
in
terms
of
the
number
of
metrics
just
so
they're
easy
for
people
to
kind
of
understand.
This.
B
A
B
Like
I
would
like,
if
I
was
to
factor
things
out,
I
think
there's
a
collection
of
things
that
are
really
more
risk
oriented
than
they
are
welcome.
This
oriented,
in
fact,
licensing
and
stability
I
think
both
of
those
I
would
maybe
look
at
as
an
introductory
risk
model
or
a
starter
risk
metric
model.
G
C
Do
also
remember,
when
we
were
doing
that
research
that
licensing
was
brought
up
as
a
reason
people
do
leave
communities
so
or
join
communities.
If
it's
got
a
really,
you
know
strict
license,
then
people
will
not
join
so,
even
though
it
doesn't
seem
like
that
kind
of
fits
in
with
welcomingess
I
think
it
kind
of
does
no.
B
No
you're
right,
maybe
we
could
have
like
because
I
think
that's
a
narrower
case
than
some
of
the
massive
license
scanning
work
that
we
do
under
licensing
we're
looking
at
file
level,
declarations,
I,
think,
I,
think
that
am
I
right,
that
that
issue
Elizabeth
would
be
really
more
around
the
project
level
declared
license
yeah.
G
B
A
A
I
mean
what
about
even
from
stability
like
things
like
elephant
factor
and
bus
Factor,
they
can
be
indicators
that
you
know.
One
person
is
doing
50
of
the
contributions
or
one
company
is
kind
of
doing
percent,
of
the
contributions
that
it
may
not
be
the
most
like.
D
Awesome
I
think
for
the
bus
factor
is
more
relevant
relevant
to
the
to
this
community,
who,
which
is,
is
organized
by
more
individual
people
instead
of
the
organizations
or
companies.
But
the
elephant
factor
is
more
about
the
multiple
organizations
drawing
this.
These
communities
are
similar,
but
they
have
the
different
things.
A
E
D
Different
context,
I
mean
a
context
of
the
of
this
community.
For
my
for
for
for
my
understanding,
it's
these
two
metrics
in
this.
If
we
consider
as
a
matrix
model,
these
two
metrics
should
be
considered
as
one
to
tell
then
okay,
if,
if
you
contact,
if
you
contact
so
the
community,
it's
a
thing:
it's
an
individual
one
or
it's
a
multiple
organizations.
You
should
consider
separately.
B
F
A
Any
what
else
in
here
code
of
conduct,
do
you
think
that's
a
good
one,
inclusive
leadership,
good
one
issue,
age
response
times
seem
pretty
good
to
me.
They
seem.
F
D
Didn't
have
with
the
exactly
exact
definition
how
to
how
to
calculate
these
metrics.
Maybe
they
we
can
give
them
an
example
for,
for
example,
the
code
of
conduct
yeah.
So
they
should,
you
know,
show
their
code
of
conductor
in
the
GitHub
or
the
on
the
on
the
on
their
website.
So
that's
that's
the
one.
B
B
C
Sorry
I
didn't
mean
nerfed,
you
I
was
just
gonna
say
we
could
do
it
like
we
do
the
badging,
where
we
have
a
list
of
things
that
they
check
off.
Like
yes,
it's
published.
Yes,
it's
you
know,
we
enforce
it.
Yes,
we
have
someone,
people
can
contact
if
there's
a
problem
like
we
train.
People
like
there
are
things
that
they
can
do
around
that
code
of
conduct.
So
it
could
be.
C
E
Also
I
would
be
like
to
ask
you,
where
I'll
be
a
final
score,
that
Aggregates
all
these
metrics
in
this
model,
like
community
service
model,
sure
have
developed
in
fumbles.
B
D
Yeah
so
wait,
I
think
the
final
skull
is
is
important,
but
it's
not
mandatory
for
for
for
all
the
matrix
model,
it's
a
more
meaningful
as
of
the
most
meaningful
things
in
matrix
model,
actually
should
be
the
the
side
of
Matrix
to
tell
us
the
user
story
behind
it.
So
people
could
understand
how
to
use
this
couple
of
metrics
to
to
to
say
some.
D
You
know
meaningful
things
like
the
the
descriptions
in
in
the
with
the
stories
and
if
we
declared
clarity,
so
it
would
be
helpful
for
now
and
maybe
in
the
future.
We
have
more
good
ways
to
define
or
get
some
final
score
definition
to
support
for
all
the
matrix
model,
but
we
can
leave
it
alone,
leave
it
now,
for
now
at
least.
A
That's
I
think
that's
fair.
Listening
to
your
talk,
I
had
a
a
question
that
I'll
probably
get
a
no
on,
but
what,
if
we
on
the
metrics
models
that
we
are
currently
developing,
we
get
rid
of
the
qualitative
measures
and
we
simply
focus
on
for
the
time
being,
metrics
that
can
be
determined
from
Trace
data
and
things
like
code
of
conduct
and
inclusive
leadership
are
included
in
other
metrics
models
like
project
badging,
yeah,
inclusive
leadership
is
qualitative
code
of
conduct.
I
think
you
can
treat
as
a
binary
doing
well.
A
C
B
G
So
can
we
quantify
the
inclusive
leadership?
Maybe
if
we
look
at
the
metric
and
find
the
ways-
and
we
can
have
it
a
quantitative
aspects.
B
G
A
G
If
is
it
necessary
that
we
use
the
metric
in
the
entirety
in
the
model
we
can
like
take
a
measure
of
quantifiable
measure
and
fitted
in
the
model.
Still
we
are
using
the
metric.
A
G
G
C
E
B
E
C
Yeah
she's
really
good
at
keeping
the
bad
guys
away.
I
guess
because
he's
never
had
a
problem,
so
she
just
keeps
I
have
mixed
feelings
about
this,
because
I
think
it
can
be
an
indicator.
If
you
have
had
no
new
contributors
in
a
year,
then
maybe
there
maybe
that's
an
indication
that
something.
C
A
A
I
think
even
just
this
conversation
has
helped
me
a
little
bit
because
I
think
there's
things
like
test
coverage
and
probably
CIA
best
practice,
but
there's
like
I
can
already
see,
like
probably
five,
that
may
kind
of
go
to
the
sideline
a
little
bit.
So
what
I'll
do
is
I'll
bring
this
back
to
everybody,
and
that
would
be
great
all
right.
So
that's
the
next
one
that
I
think
we're
working
on.
A
Have
have
an
interest
in
taking
a
look
at
Community
fatigue,
just
maybe
before
the
next
meeting,
or
is
there
a
metric
model
that
somebody
might
be
interested
in
kind
of
helping
Advance.
F
A
C
E
A
A
All
right
cool-
let's
see
I'm
gonna,
come
back
to
this
I
I
did
want
to
just
point
out
for
people
as
well
we're
kind
of
wrapping
up
here
in
time.
There
was
this.
There
was
this
ospology
live
session,
and
here
are
some
notes
that
were
taken
from
it.
I
was
gonna.
I
really
haven't
had
a
chance
to
do
this
yet.
A
But
there
are
some
interesting,
perhaps
questions
in
here,
so
around
activity
release
Cadence
dependencies,
I'm,
just
I'm
going
to
take
a
look
at
what
came
up
with
this
session
from
us
apology
live
and
see
if
it
relates
to
any
metrics
models
that
we
already
have
published
or
if
it
would
result
in
new
models.
G
G
D
A
D
D
I
think
it's
really
good
at
input
for
us
and
yeah.
We
can
work
on
that
to
adapt
them
to
make
an
adaption.
D
B
A
Great
before
I
get
to
the
last
point,
I
just
wanted
to
to
re-emphasize
for
people
the
Common
working
group-
I'm,
just
gonna
put
it
in
here
is
a
working
group
that
meets
that's
not
a
convenient
time
for
all
of
you
in
China,
but
the
Common
working
group
is
I'm,
gonna,
be
we're
meeting
this
Thursday
and
we're
shifting
our
Focus
just
a
little
bit
to
be
the
working
group
that
is
responsible
for
publishing,
or
at
least
starting
to
publish
the
metrics
that
aren't
already
published
in
the
metrics
models.
A
D
A
D
D
And
how
already
defined
some
new
metrics
from
from
that.
D
A
Week
great
and
we
had
tried
to,
we
had
tried
the
approach
of
like
placing
an
issue
inside
of
their
respective
working
group
to
have
the
working
group
develop
the
metric
and
that
didn't
work.
The
issue
just
got
created
and
then
just
sat
there,
and
so
we're
going
to
have
a
a
more
dedicated
group
of
people
to
build
these
metrics
sure
yep.
G
A
A
We
like
to
see
from
that
collaboration.
Are
we
hoping
to
have
the
members
of
that
conversation
kind
of
verbalize
new
metric
models
that
they
would
like
to
see?
Are
we
hoping
I,
you
know
I
don't
know?
Is
there.
B
B
Okay
and
I
I
think
it's
I
think
getting
some
of
the
folks
who
are
on
that
call
from
hospitals
to
open
up
about
how
they're
overwhelmed
could
be
one
path
to
refining,
past
metrics
and
metrics
models
and
the
tools
around
those
two
meet
the
needs
like
I,
think
it's
a
real
opportunity
to
know
what
needs
to
be
in
that?
What
okay?
You
need
to
do
that.
Okay,.
A
A
A
Yeah,
so
we
this
was
the
value
working
group
and
we
just
converted
it
so
basically
I
know
we're
overtime.
But
let
me
explain
this
real
fast.
So
one
of
the
things
that
we're
doing
in
the
chaos
project
is
we're.
Finding
that
there's
a
need
for
people
say
from
open
source
program
offices
in
corporations
to
talk
amongst
themselves
around
the
metrics,
the
data
and
the
metrics
models
that
they
would
like
to
see
right.
D
Yeah
I,
I,
I,
I,
guess
I,
know
the
background
about
it.
I
just
want
to
declare
that
the
two-do
chaos
working
group
will
just
it
is
the
working
group
hospital
and
that's
defined
the
ER.
B
A
A
So
I'm
gonna
can
I
I'm
gonna
if
it's
okay,
I'm
gonna,
to
open
this
question,
also
in
slack
because
I,
we
really
have
an
opportunity
to
kind
of
help,
build
models
and
deploy
models
that
are
highly
relevant
to
to
hospital
managers
and
I.
Think
it's
important
for
us
to
Sean's
point
I
really
like
what
you
talked
about
Sean
like
what
are
the
ways
that
we
can
talk
about
this
in
the
the
ospo
working
group
that
can
kind
of
elicit
what
those
models
can
be.
You.
G
A
D
Yeah
I
mean
we
can
got
a
lot
of
input
and
swords
from
the
from
the
hospital
working
group,
and
we
can.
We
can
give
them
some
Solutions
on
how
to
defund
it
by
our
metrics
and
how
to
implement
it
with
tools.
That's
it's
going
to
be
helpful.
Yeah
I.
A
Think
so,
too!
Okay!
So
that's
that
great
we're
at
the
End
of
Time
everybody
to
see
you
all
and
our
next
meeting
is
going
to
be
February.