►
From YouTube: CHAOSS Value Metrics - Andy Leak
Description
Speaker: Andy Leak
Organization: Mountain View Smart Contracts
The CHAOSS Value Metrics Group started in Spring 2019. In this talk, we will describe the Value Metrics and how they relate to Open Source Program Offices. We will describe new software tools for measuring Economic Value, present the results of an email survey, and describe lessons learned in a series of interviews with Open Source Program Offices. We'll discuss next steps, and potential efforts to build connections between OSPO offices for networking and learning.
A
My
name
is
Andy
very
nice
to
see
all
of
you
here
in
the
audience
today.
I'm
going
to
be
talking
about
value,
metrics
chaos,
as
you
all
probably
know,
has
got
four
working
groups.
Value
metrics
is
one
of
the
four
and
it's
quite
possibly
the
newest
working
group.
So
this
is
the
first
time
you've.
If
this
is
the
first
time
you've
heard
about
value
metrics.
The
reason
is:
it's
never
been
spoken
to
at
a
kiosk
on
before
with
the
value
metrics
group.
A
We
are
very
much
in
discovery
mode
and
I
really
encourage
questions,
any
kind
of
feedback
or
comments
you
have
as
we
go
along
I'd
love
to
hear
them.
So
what
I'm
prepared
to
do
today
is
give
a
little
introduction
to
our
group.
I
want
to
tell
you
about
what
types
of
help
we
would
like
to
have
going
forward
and,
as
I
said,
really
value
discussion.
So
on
this
slide,
I
have
to
admit:
I
made
a
change
to
this
slide
in
reaction
to
Matt's
presentation.
Can
anyone
guess.
A
A
The
common
thread
that
we
have
is
that
we
are
all
suffer
people
and
we
would
like
to
sort
of
expand
the
the
type
of
participants
as
we
go
forward.
I'll
talk
about
that
as
as
we
get
into
as
we
get
into
the
talk,
we
do
have
a
live
meetup
every
other
Friday
everybody's
welcome.
So
we've
got
a
really
nice
repo
and
working
documents.
Go
there
and
browse
and
you'll
find
our
meeting
times.
We'd
love
to
have
you
okay.
So
let's
talk
about
just
the
definition
of
value
metrics.
What
are
we
talking
about?
A
So
primarily
we're
talking
about
metrics
that
indicate
economic
value.
So
you
know
a
lot
of
the
discussions
are
actually
you
know
putting
economics
sort
of
on
the
backburner,
but
here
in
the
value
group
you
know
they're
front
and
center,
and
when
we
talk
about
economics,
primarily
we're
talking
about
financial
metrics,
things
like
cost
to
fix
a
bug
time
to
launch
a
project.
So
you
know,
project
velocity
has
very
much
of
an
economic
component
in
in
just
a
whole
ton
of
business
domains.
A
Recruiting
is
a
recurring
theme
that
comes
up
open
source
for
business.
Certainly,
you've
got
relevance
to
recruiting.
People
are
using
open
source
to
build
brands.
You
know
Red
Hat,
just
just
had
a
mighty
sale,
mighty
acquisition,
tremendous
brand
value
there.
So
what
we're
talking
about
with
value
metrics
are
economic
values,
things
that
can
be
primarily
expressed
in
dollars
and
cents
and
the
common
themes
that
that
run
through
value
metrics.
A
Now,
when
you
talk
about
metrics
I
mean
there's
literally
thousands
of
ways
that
you
can
apply
value
metrics
to
you,
know
dozens
of
different
use
cases
and
so
for
us
to
get
started
really
focused
to
audiences.
One
is
the
open-source
program
office
manager,
so
the
metrics
that
we
produce
are
designed
to
help
that
person
answer
the
question.
You
know
how
can
I
go
and
justify
my
program
to
my
management?
A
Are
you
know
oftentimes
in
conflict?
You
know
a
lot
of
times.
Justification
for
open
source
program
office
is
hey.
We
can
get
a
whole
ton
of
free
labor.
You
know
to
come
in
and
and
work
on,
our
you
know
to
work
on
our
programs,
so
just
figuring
out
strategies
for
contributors
where
they
can
make
a
legitimate.
You
know
working
wage,
something
that's
sustainable.
Something
that's
stable
is
something
personally
that
I
would
like
to
have
us
an
outcome
for
this
project.
A
So
we
started
work
on
value
metrics
of
around
April
in
the
first
four
months
of
our
life.
Basically,
we
just
got
the
program
up
and
running
from
scratch.
We've
got
tooling,
we've
got
work
process,
we
published
a
set
of
initial
metrics
a
few
weeks
ago.
We've
got
a
core
community
and
and
contributors,
and
that
we've
got
a
roadmap
to
move
forward,
and
the
roadmap
to
move
forward
is
to
two
major
things.
One
is
over
the
next
few
months.
A
A
You
know:
go
from
just
a
revi
page
to
a
live
working
saw,
for
example,
and
one
of
the
interesting
things
about
our
value
metrics
is
that
a
lot
of
the
metrics
that
that
we
have
I
think
are
going
to
be
slightly
different
than
the
other
groups
in
that
they're
they're
very
much
a
parameter
driven.
So
we
will
look
at
things
like,
for
example,
the
cost
to
close
a
bug
as
an
economic
metric,
and
the
actual
cost
depends
on
your
labor
rate
and,
and
we
know
that
labor
rates
vary
geography
by
geography
organization
by
organization.
A
So
one
of
the
things
that
we
will
do
is
is
to
you
know,
do
some
exploration
around
parameter,
driven
metrics
and
to
figure
out
see
if
we
can
figure
out
best
practice
for
for
doing
now.
The
other
thing
that
we
will
do
is
we
would
like
to
add
a
steering
committee.
So,
as
a
group
right
now,
we
we
are,
we've
got
a
kind
of
a
uniform
profile,
we're
all
software
people.
A
We
would
like
to
add
a
couple
of
different
perspectives
to
our
group.
Open-Source
program
managers
and
economic
experts
I'd
like
to
get
summers
between
two
and
four
folks
onto
our
steering
committee,
and
what
we're
going
to
ask
of
the
steering
committee
is
it's
actually
pretty
lightweight
we'd
like
him
to
review
our
metrics
as
they
are
published
of
typically
on
a
twice
a
year
schedule,
so
we're
gonna
ask
for
a
review
and
some
feedback
kind
of
a
half,
a
day's
involvement.
A
This
is
the
profile
of
person
that
we're
looking
for
we'd
like
to
get
economists,
investment
bankers,
financial
analysts,
strategy,
consultants,
I
mean
you
know
an
ideal
person
would
be
that
that
M&A
banker,
who
you
know,
got
the
red
hat
deal
done
so
they
definitely
have
got.
You
know,
frameworks
and
valuation
models
that
they
used.
We'd
like
to
have
the
perspective
of
those
those
types
of
people
helping
us
out
with
value
metrics.
A
You
know
which
ones
seem
most
relevant
to
our
particular
situation
and
then
the
other
mode
that
metrics
can
be
used
is
is
in
a
coordination
mode
and
in
the
software
business,
just
like
every
business.
You
know,
there's
just
a
huge
network
of
stakeholders
that
participate
in
the
production
of
assets.
A
A
This
big
web
of
relationships
and
what
we
know
by
looking
at
by
looking
at
other
sort
of
economic
systems,
is
that
you
know
they
don't
run
on
a
thousand
signals.
You
know.
Typically,
what
happens
is
you've
got
a
consensus
that
builds
up
you
know
round
around
one
or
two
metrics
and
that
that
is
used
to
coordinate.
A
You
know
a
whole
slew
of
economic
activity
like,
for
example,
if
you're
a
commodity
trader
if
you're
trading
corn,
you
know
one
of
the
signals,
one
of
the
big
signals
that
they
use
is
weather
forecasts
you
know,
is
it
going
to
be
drought,
or
is
it
going
to
be
optimal
growing
conditions
and
that
one
metric
just
guides
a
whole
slew
of
economic
activity?
You
know
all
the
way
from
the
commodity
trader
down
to
the
farmer,
to
the
the
banker
who
provides
finance
to
the
farmer,
to
the
tractor
dealer
and
so
forth.
A
So
one
of
the
challenges
that
we
will
have
is
is
you
know,
trying
to
try
to
sort
of
reduce
down
the
number
of
signals
into
just
a
handful.
That
can
be
used
to
coordinate
activity.
You
know
across
the
software
supply
chain
and
I'm
hopeful
that
if
we
get
some
more
folks
in
the
room,
you
know
who've
got
experts
in
economics
and
and
different
types
of
financial
system.
That
that'll
be
helpful.
A
So,
in
addition
to
steering
committee
very
soon
we're
going
to
have
working
software
that
we
can
get
our
hands
on
with
auger
we've
got
green
more.
We
do
want
to
start
building
this
out
and
to
demonstrate.
You
know,
live
working
economic
signals
across
a
whole
slew
of
software
projects
that
we've
identified
and
we're
going
to
need
help
with
that,
so
a
peer
person
who,
who
is
hands-on
if
you
like
to
write
documentation,
if
you
know
docker,
if
your
database
person,
we
would
really
would
love
to
have
your
help.
A
A
What
you
think
we
should
be
focusing
on.
If
you
run
an
open-source
program
office,
I
would
really
love
to
hear
you
know.
What
do
you
do
to
justify
your
performance
to
your
managers?
Is
it?
Is
it
dollars
and
cents
based?
Is
it
more
about
brand
or
recruiting?
You
know
that
kind
of
feedback
is
super
valuable
for
us.
B
A
You
know
a
lot
depends
on
your
motivation
for
what
you'd
like
to
do
with
the
software.
Maybe
some
of
the
students
would
like
to
take
the
code
and
with
their
knowledge
you
know,
go
out
and
you
know
pitch
it
as
a
startup
company
or
raise
financing.
So
some
of
those
value,
metrics
I,
think,
would
be
really
useful
for
that.
If
people
have
that
ambition.
A
So
the
question
is,
you
know
what
about?
Maybe
the
wider
ecosystem
are
looking
at.
You
know
kind
of
the
embedded
value
of
a
project
that
you
use
and
I
think
the
answer
is
yeah.
There
could
be
something
that
we
look
at
okay,
so
so,
as
I
said,
you
know
in
thinking
about
value,
metrics,
there's
just
a
whole
slew
of
use
cases
that
you
might
you
might
choose
to.
A
You
know,
focus
your
your
target
on,
and
so
if
people
came
back
to
us
and
said
hey,
what
I
really
would
like
to
do
is
to
show
the
economic
value
of
all
the
open
source
stuff
that
I've
incorporated
into
my
own
project
for
my
own
company.
We
could
do
that,
so
you
know
we
can
really
aim
the
gun
at
wherever
you
all
would
like
us
to
go
and
right
now
we're
we're
focused
on
those
two
use
cases.
A
C
A
So
one
of
the
things
I
imagine
would
happen
in
that
type
of
a
world.
Is
that
as
a
grant
maker,
you
could
be
looking
at
a
situation
where
there's
an
inefficient
use
of
funds.
You
know,
perhaps
you
give
one
group
a
million
bucks
and
you
give
another
group
a
million
bucks
and
they
end
up
kind
of
recreating
the
wheel
with
with
no
coordination
between
the
two
of
them.
A
Kind
of
the
bottom
line
is:
if,
if
people
do
have
these
type
of
scenarios
come
and
come
and
talk
to
us
about
it,
because
we
like
to
tailor
what
we
do
in
this
group
in
such
way
that
actually
solves
you
know
you,
so
your
customers,
you
know
for
for
these
metrics.
So
we
very
much
like
to
you
know
solve
the
real
problems
that
you
do
have.
C
C
A
You
know
one
thing:
maybe
you
could
you
could
express
as
an
economic
value
is
the
the
cost
of
training
somebody.
So
you
know
you've
got
students
running
through
your
programs.
You're
spending
funds
to
get
somebody
up
to
a
certain
level
of
competence,
certainly
there's
a
whole
slew
of
economic
metrics.
That
almost
everybody
cares
about
in
terms
of
being
able
to
treat
people
to
a
level
of
confidence
for
the
lowest
possible
cost
and
to
reduce
the
time
that
it
takes
for
somebody
to
get
up
to
speed.
A
D
D
A
D
D
A
So
any
opportunity
we
have
to
work
with
a
group
like
that.
You
know
we
can
set
up
a
time
to
talk
and
we'd
love
to
just
tell
people
what
we're
up
to
and
I
am
pretty
confident
that
you
know
when
we
get
out
there,
and
especially
we've
got
our
metrics
backed
up
by
live
software
tools
that
it's
going
to
be
a
really
interesting
discussion
with
a
lot
of
organizations.
So
we'd
love
to
do
that.