►
From YouTube: Mystic - An initial effort in academic metrics, impact, and community | Stephen Jacobs & Emi Simpson
Description
Mystic - An initial effort in academic metrics, impact and community
The last few years have seen a significant uptick in interest in the concept of Open Source Program Offices in academic and governmental entities. Last year the EU adopted an Open Source Strategy for 2020-2023. This year, the United States, The National Academies for Science, Engineering and Mathematics, has called for presidents and provosts of colleges and universities to significantly increase support for Open Work across all colleges and universities in the US. This panel will start with members of the OSPO++ working group (that meets regularly to encourage the creation of municipal and academic OSPOs) will briefly introduce attendees to the needs of these developer and user communities. It will then move to a demo of Mystic, and Open@RIT effort to use GrimoireLab to collect data and display data on faculty Open Work contributions. Questions for all panelists will be encouraged in the last ten minutes.
A
It
all
right,
ladies
gentlemen,
and
those
of
us
who
know
better
welcome
to
open
at
rit's
talk
on
mystic,
an
initial
impact,
an
initial
effort
in
academic
metrics
impact
and
community.
My
name
is
emmy
simpson.
I
use
any
pronouns
except
for
schieffer,
and
I
am
the
full
stack
developer
at
open
at
rit,
and
I
will
leave
it
with
my
co-presenter
to
introduce
himself
and
a
little
bit
more
about
us.
B
B
Open
work
happens
everywhere
in
the
university
open
software,
open
hardware,
open
research,
open
science,
open
data,
open,
oers,
open
other
things,
I've
forgotten,
we
tend
to
bubble
those
as
open
work
and
that's.
Why
we're
an
open
programs
office
at
rit
versus
an
open
source
programs
office,
because
we
wanted
to
signal
to
the
entire
academic
community,
artists,
humanitarian
folks,
etc.
B
We
are
not
building
stuff
for
them.
We
are
helping
them
move
stuff
out
in
the
open
because
they
don't
know
how
to
we're,
helping
them.
Reboot
an
open
source
community
by
providing
better
coms,
better
web
access.
Those
types
of
things
so,
unlike
most
support
teams
in
open
source,
where
you
find
primarily
engineers
emmy,
is
my
current
engineer,
go
emmy,
but
everybody
else
is
ui
ux,
project
management,
writer,
designer
industrial.
We
have
an
industrial
designer
working
on
our
playbook,
so
we're
almost
a
digital
services
bureau
to
support
open
research.
B
We
have
in
industry,
you
have
your
employees
and
you
work
with
your
employees,
their
staff.
Their
roles
are
well
defined
and
generally
they're
supposed
to
do
what
you
tell
them.
We
have
students
and
students
are
in
fact
a
different
class
now
that
feels
like
it
should
be
obvious
on
its
face,
but
it's
not
in
that
at
most
universities,
they're,
essentially
staff,
in
that
anything
they
do
is
owned
by
the
university
right
with
its
homework
or
anything
else.
B
It's
gray
and
speaking
as
a
faculty
member.
I
can
say
that
you
can't
tell
us
to
do
anything
anyway,
so
whatever
you
try
to
set
up
may
or
may
not
take
hold
so
various
different
folks
and
in
an
ideal
world.
However,
most
of
these
folks
are
aiming
at
research
and
scholarship
and
open
open
work.
First,
how
do
we
coordinate
this?
How
do
we
even
find
out
who's
doing
what
on
campus
well
hopkins
myself
other
folks
we're
trying
to
figure
that
out
and
one
way
that
we're
trying
to
figure
that
out
is
through
the
stuff.
B
One
way
we're
hoping
to
collect
data
on
what
faculty
are
doing
in
terms
of
things
being
open
is
to
give
them
the
tools
they
need
to
defend
their
open
work
right
faculty
generally,
get
involved,
get
evaluated,
offered
tenure,
offered
promotion
based
on
things
like
numbers
of
public,
published
journal
articles
and
how
many
people
have
included
that
research
written
that
research
whatsoever.
It's
a
very
slow
process.
It's
a
very
long
tale.
Academia
doesn't
really
want
to
move
more
toward
doing
something.
B
A
B
A
All
right,
so,
let's
dive
a
little
bit
deeper
into
the
question
of
why
mystic
and
I
think
to
do
that.
An
important
thing
to
look
at
is
what
is
the
state
of
open
source
at
our
university
and
no
doubt
at
a
whole
bunch
of
universities,
as
it
is
right
now.
Well,
the
current
state
is
that
we
have
absolutely
no
metrics.
We
have
no
idea
what
the
current
state
of
open
source
that
the
university
is
like.
A
You
know,
we've
got
open
source
going
on,
but
we
have
no
way
of
measuring
how
much
or
what
it
looks
like
you
know
there
could
be
10
groups
working
on
open
source
at
the
university.
There
could
be
20,
there
could
be
a
hundred
there
could
be.
Every
person
in
the
university
is
currently
doing
open
work,
but
we
don't
know
about
it
because
problem
number
two
open
source
projects
rarely
communicate
with
each
other.
A
We
don't
have
the
ability
to
provide
resources
to
these
groups,
because
it's
very
hard
to
provide
resources
to
a
group
that
you
don't
know
exists
and
it's
very
hard
to
know,
provide
resources
to
a
group
that
doesn't
know
that
you
exist.
That's
not
an
easy
task,
and
it's
not
one
that
frankly
we
can.
We
can
really
do
it
all
so,
integramore
lab
I'm
assuming
that
everybody
here
didn't
stumble
into
chaos
con
without
knowing
very
much
about
femoral
lab,
but
just
in
case,
because
I
want
to
talk
about
it.
A
I'm
going
to
pretend
that
you
don't
and
in
fact
I'm
not
just
going
to
pretend
that
you
don't
I'm
going
to
pretend
that
you
are
perhaps
a
liberal
arts
professor
who
doesn't
know
what
gomorrah
lab
is,
and
you
have
just
stumbled
in
to
open
at
rit
and
we're
going
to
we're
going
to
help
you
get
set
up
with
guaramala
to
help
you
grow
your
community.
So
thankfully
it's
a
very
simple
project
process.
A
This
right
here
is
the
bestiary
interface,
which
allows
you
to
have
open
open
ecosystems,
and
you
just
add
open
projects
to
that,
and
you
can
add
several
data
sources
of
a
type,
don't
forget
to
add
your
github
api
key
and
after
that,
you'll
get
all
of
these
very
fancy.
Graphs
on
inhibitors
here
and
wait,
wait
hold
on
hold
on.
I
just
gotta.
Add
you
into
the
mortgage.
Configuration
calibration
just
take
a
second
all
right,
all
right
and
now
you'll
be
over
here
on
that
and
okay.
C
D
A
So
number
one
it's
difficult
to
understand.
We
just
went
over
that.
It's
a
very
big
graph
and
huge
kudos
to
everybody
who
helped
develop
the
components
on
that
graph
because
it
accomplishes
a
very
important
task
and
all
of
those
components,
working
in
synchronous
or
synchronocity
is
a
very
impressive
feat
and
it
accomplishes
some
very
fancy
data
science,
but
it's
a
little
bit
hard
to
get
into
as
someone
who
is
not
familiar
with
the
project
number
two
there's
not
that
much
access
controls,
grammar
lab,
works
great.
A
Now
one
person's
mistake
might
corrupt
a
config
file
that
makes
a
service
offline
for
everybody
or
god
forbid.
You
have
a
malicious
actor.
Who
deliberately
wants
to
do
something
to
mess
with
the
system?
There's
not
too
many
access
controls
on
the
existing
romar
lab
suite
of
projects
and
number
three.
You
have
some
very
disparate
components.
In
that
last
slide,
we
had
a
screenshot
of
curator,
which
is
the
fork
of
cabana.
That
is,
has
lots
of
very
fancy
grass.
A
We
want
to
make
it
easy
to
use.
We
want
to
make
it
so
that
there
are
any
liberal
art
professor
can
come
in
and
understand
it
right
off
the
bat
or
at
least
very
easily,
and
we
want
to
add
access
control
so
that
we
can
open
this
up
to
an
even
wider
community,
so
rather
than
kind
of
describing
mystic
to
you,
I'd
like
to
be
able
to
take
a
minute
to
show
you
it.
A
So
here's
what
you
get
when
you
first
create
a
mystic
account.
You
get
one
very
big
button
that
allows
you
to
add
a
project
and,
let's
just
pretend
I
slapped
that
button
boom.
This
is
what
it
looks
like
to
add
a
project
to
mystic,
so
you
have
about
four
text
fields.
It
all
fits
on
one
screen,
just
a
project
name
description.
You
can
add
data
sources
with
just
a
drop
down
box
and
text
field,
and
you
can
also
add
multiple
authors.
A
So,
let's
just
fill
in
some
information
there
just
pretend
that
that
was
a
perfectly
seamless
transition.
Wow
I
mean
your
transition
was
so
seamless.
I
couldn't
tell
that
you
just
switched
from
a
static
image
to
a
to
a
video,
but
all
right.
Let's,
let's
fill
in
the
description,
we
can
jump
down
and
add
data
sources.
C
A
Need
to
memorize
what
data
sources
it's
all
right
there
and
you
can
type
in
things
just
like
that.
We're
going
to
add
a
url
for
mystic,
as
well
as
one
more
url
for
a
separate
piece
of
software
called
mystic
coordinator
that
I
won't
be
talking
about
too
much
unless
people
want
to
talk
about
it
in
the
q
a
but
just
like
that,
we've
already
set
up
a
project.
C
A
Would
be
listed
as
a
co-maintainer,
so
once
we
hit
save
another
seamless
transition
and
we
have
a
nice
little
card
for
mystic
right
there,
but
mystic
does
more
than
create
pretty
cards.
So
if
we
click
on
that
card,
we'll
get
a
whole
page
automatically
generated
from
just
that
information
that
we
put
in
there.
So
we've
already
got
maintainers.
We
have
a
brief
description
and
all
of
the
links
that
we're
using
to
collect
data
about
these
projects
are
also
listed
there,
because
those
links
don't
happen
to
just
be
a
place
where
you
can
find
data.
A
It
also
happens
to
be
a
place
where
you
can
find
information
about
the
project,
and
so
we
include
that
on
the
page
as
well
as
well
as
some
drafts
and
let's
zoom
in
on
that
I've
actually
pulled
a
bit
of
a
switch
over
there.
These
are
not
the
mystic
graphs
but
drafts
from
unrelated
projects,
because
I
wanted
to
show
off
the
issue
durations
graph
and
there
aren't
enough
issues
in
mystic
to
be
able
to
do
that.
Quite
yet.
A
But
these
are
just
three
of
the
graphs
that
are
currently
programmed
in
which
are
dynamically
shown
based
on
what
sort
of
links
you've
added
into
the
project.
So
because
we've
added
two
git
lab
links,
we
get
three
gaps
for
that
right
now:
a
contributors
graph
which
measures
not
just
the
contributors
who
have
code
commits
in
the
repository,
but
any
kind
of
contribution
whatsoever.
So
that
can
be
opening
an
issue
responding
to
an
issue.
A
We
also
have
many
other
types
of
data
sources
in
there
like
the
open
science
foundation,
as
well
as
things
like
matter
most.
So
if
you
add
a
contribution
to
an
open
science
foundation
project
or
if
you're
talking
a
lot
in
the
matter,
most
contributions
or
in
the
mattermost
channel,
you
will
also
get
just
played.
A
We
can
see
that
as
far
as
issues
goes,
almost
half
of
the
issues
are
closed
in
less
than
a
day.
The
rest
are
closed
in
less
than
a
week,
but
there
are
a
few
that
remain
open
for
a
year
or
a
little
bit
longer.
So
you
could
use
that
information
in
ways
that
I'm
sure
you're
all
familiar
with
figuring
out
what
kinds
of
issues
obtained,
what
kind
of
thoughts
and
optimizing
it
so
that
your
community
becomes
more
friendly
and
more
welcoming.
A
A
A
second
and
up
in
the
top
left
corner,
I'm
just
going
to
click
that
explorer
button.
Pretend
I'm
doing
this
with
my
cursor,
but
I'm
not
so
this
is
another
core
page.
That's
part
of
mystic,
and
so
here
is
a
display
of
all
of
the
projects
in
mystic,
because
that
page
is
very
nice,
the
one
that
I
just
showed
you,
but
I
already
know
what
mystic
is
I
typed
that
information
in?
I
don't
need
to
be
told
what
the
description
of
mystic
is
or
where
its
links
are.
A
A
A
Anyone
who's
kind
of
in
a
position
of
community
management
who
wants
to
make
their
community
bigger
and
stronger
and
healthier
missing,
is
also
a
gauge,
and
it's
a
gauge
for
not
just
the
people
sort
of
running
their
own
communities,
but
a
gauge
for
oscars
as
a
whole
or
any
kind
of
wider
community.
We
can
use
this
as
a
way
of
figuring
out
where
rit
or
whatever
university
or
ospo
or
company,
is
using
mystic
and
figure
out
where
that
organization
is
in
open
source,
get
a
measure
on
what
kind
of
projects
are
out
there.
A
What
kind
of
projects
are
active?
What
kind
of
activity
because
don't
forget
all
of
this
is
still
built
on
top
of
grammar
lab,
which
means
that
if
you
want,
you
can
easily
open
up
a
quiver
dashboard
and
render
whatever
sort
of
dashboards
and
graphs
your
data
science
loving
heart
may
want
to
see,
but
I
think
most
importantly,
mystic
is
a
platform
for
a
community
open
source.
More
so
than
anything
is
about
community.
A
B
We
get
evaluated
often
by
people
who
are
not
members
of
our
core
discipline.
I'm
a
game,
professor
in
a
college
of
computing.
Most
of
the
people
who
look
at
my
work,
evaluate
my
work.
Evaluate
me
for
tenure.
Evaluate
me
for
promotion,
don't
understand
what
I
do
to
the
point
where,
10
years
ago
ish,
we
wrote
a
10-page
document
to
accompany
every
candidate
from
my
department
that
goes
up
to
explain
no
you're
not
going
to
see
journal
articles
from
us.
For
the
most
part
we
do
different
things.
This
is
what
impact
looks
like
in
our
field.
B
A
C
A
All
right,
so
the
question
was:
how
hard
is
it
to
take
weird
data
sources
that
aren't
necessarily
easy
to
process,
gitlab
and
github
repositories
and
put
that
into
mystic
and
stuff
like
that
to
answer
that
mystic
is
built
on
top
of
grammar
lab.
So
if
grammar
lab
can
kind
of
understand
your
source,
then
that
is
something
that
mystic
can
handle
too.
A
The
one
exception
being
graphs.
Graphs
are
sort
of
manually
put
in
there,
but
if
you
can
come
up
with
an
elastic
search
query
to
be
able
to
process
that
data
into
a
graph,
then
it
can
absolutely
be
processed
by
mystic
and
in
fact,
if
you
have
your
data
sources
as
a
git
repo,
that's
something
that
can
already
be
processed
right
out
of
the
back.
Mystic
has
support
for
any
kind
of
git
repository.
B
Just
to
follow
up
on
emmy
very
quickly
before
we
go
to
sean
one
of
the
things
we
pull
data
in
from
right
now
is
the
center
for
open
sciences,
open
science
platform
osf,
so
that's
capturing
more
data
than
github
and
get
lab
different
data.
It's
looking
at
preprints,
it's
looking
at
a
bunch
of
other
things
being
able
to
build
this
out.
So
it
doesn't
just
talk
about
software
is
something
that's
that's
key
for
us
and
I
think
that's.
B
A
So
the
gramarla
data
is
actually
still
an
elastic
search.
We
use
a
mysql
database
for
tracking
users
and
tracking
some
of
the
structural
projects,
but
the
actual
core
data,
like
the
stuff
that
comes
out
in
graphs
and
all
of
the
raw
and
enriched
data
gathered
by
gomorrela,
is
still
in
a
elasticsearch
database.
D
I
was
wondering
what
efforts
you're
working
on
to
create
distinctions
between
disciplines
of
projects
like
it
seems
at
open.
Rit
they'll
have
many
different
disciplines,
academically
and
otherwise
that
are
being
represented
through
these
open.
This
open
work-
and
I
was
wondering
if
you
have
metrics
that
are
trying
to
display
that
in
some
ways.
A
So
the
question
was:
how
do
we
sort
of
display
and
represent
the
differences
in
what
kinds
of
data
and
what
kind
of
fields
are
displayed
to
answer
that
we
definitely
have
a
number
of
sources
that
are
like.
As
you
had
mentioned,
the
open
science
foundation
is
data
that
is
collected,
but
we
don't
have
a
specific
discrimination
between.
A
This
is
a
science
project,
and
this
is
a
code
project
other
than
this
has
a
bunch
of
github
links,
and
this
has
a
bunch
of
osf
links
because
I
don't
know
if
that's
a
particularly
clear
distinction
to
make
there's
a
lot
of
like
science,
open
science
foundation,
projects
that
are
also
a
lot
about
code,
and
you
can
have
a
code
project
that
refers
to
a
scientific
document
or
anything
else
that
you
can
think
of.
There's
always
going
to
be
interlinks.
E
A
So
the
question
was
for
the
portion
of
the
project
that
is
for
gauging.
How
are
we
choosing
which
projects
to
compare
that
might
actually
be
a
little
bit
more
of
an
sga
question,
but
the
the
main
way
that
we're
doing
that
right
now
is,
although
it
might
be
in
the
future,
predominantly
through
dashboards
like
qubiter,
which
allow
you
to
do
analysis
of
the
elastic
search
data.
A
B
So
that
alpha
part
right
right
now
we're
working
with.
So,
as
I
said,
we
have
this
pool
of
what
will
eventually
be
30
projects.
We
support
over
two
years
we're
starting
with
those
just
to
try
to
use
them
as
a
sample
to
figure
out
what
we
need
to
do
and
how
we
can
build
things
out.
We
probably
won't
roll
this
out
to
the
faculty
at
large,
for
you
know,
probably
starting
in
calendar
year,
2022.
E
A
Yeah,
so
the
question
was
as
a
follow-up
given
project
a
and
project
b,
your
mystic
is
not
the
thing
choosing
to
compare
those
two
projects,
it's
something
that
is
done
manually
and
yes,
mystic
does
not,
at
least
at
the
moment,
have
any
sort
of
facilities
to
automatically
compare
those
things.
Yeah.
B
The
whole
space
of
of
academic
analytics
is
very
mushy
very
mushy.
There
was
there's
been
this
debate
off
and
on
about
alt
metrics
right,
you
know.
Well,
I
get
lots
of
people
coming
to
my
blog
right
well,
but
are
they
peer
reviewed
people?
Are
they
really
using
your
stuff?
Are?
Are
you
gaming
it
and
having
all
your
friends
put
stars
on
this?
You
know
there's
this
back
and
forth
about.
B
How
do
you
move
away
from
what
used
to
be
the
gold
standard,
hopefully
of
journal
articles,
because
we
do
even
that
badly
right
at
this
point,
those
who
are
professors
or
graduate
students?
Here
you
know
we
you,
you
set
up
your
google
scholar
account
and
it
searches
the
web
and
it
finds
out
how
many
people
have
mentioned
your
thing,
and
that
gives
you
what
is
it
an
h
value,
an
h
factor?
I
can't
even
an
h
index
right
so
so
already
they're
reducing
your
entire
scholarly
career
to
a
two
digit
number.
B
It's
far
from
ideal
and
and
it's
a
big
we're
hoping
to
put
some
some
concrete
examples
into
that
debate,
to
try
to
get
things
expanded
out,
but
it's
going
to
be
a
long
process
and
the
only
reason
that
it's
probably
going
to
pick
up
the
speed
is,
as
I
said,
the
the
national
academies
are
now
making
a
big
push
to
have
people
open
if
you're,
not
in
academia
or
research.
There
used
to
be
this
old
commercial
for
a
brokerage
firm.