►
From YouTube: DORA4 Metrics design Discussion
B
A
A
Historically,
three
or
four
different
designers
worked
on
this
and
so
there's
kind
of
different
kinds
of
designs
all
over
the
issues
and
there's
a
little
bit
of
them
confusing.
C
Yes,
can
everyone
see
my
screen.
D
C
Cool,
so
I'm
gonna
walk
through
a
high
level
of
what
I
understood
in
terms
of
putting
this
together.
So
if
you
see
a
mistake
or
read,
definitely
call
it
out,
so
we
can
move
forward
from
there.
So.
C
The
idea
is
that
we're
going
to
introduce
the
door
four
metrics
kind
of
tile
at
the
top
of
the
cicd
analytics
page,
and
this
just
gives
one
high-level
piece
of
data
for
each
of
the
door,
four
metrics,
which
is
kind
of
convenient,
because
there
are
four
of
them
and
that's
all
it
does,
and
this
is
only
at
the
project
level
and
then
the
rest
of
these
charts
for
ci
cd
should
already
be
there
and
should
be
the
standard
that
we're
working
off
of.
A
But
don't
don't
continue
to
the
core?
I
just
wanted
to
take
a
step
back
and
and
remind
everyone
that
at
the
moment,
we
put
everything
in
ultimate
and
that's
intentional.
A
E
A
So,
just
to
talk
about
the
persona
and
who's
interested
in
door,
four
metrics,
there's
really
two
that
we
noted
in
the
issue.
Maybe
there's
more
but
there's
two
that
we're
kind
of
are
focusing
our
first.
One
of
them
is
for
the
executive
team,
which
is
interested
in
like,
but
how
the
company
is
doing
or
how
different
groups
are
doing
and
they're
really
interested
in
seeing
performance
of
different
groups
around
devops
and
their
entire
sdlc
lifecycle
and
the
other
one
is
the
specific
team
that
are
interested
in
their
own.
A
A
E
One
question
about
this
is:
is
it
going
to
be
in
every
tier
for
both
project
and
group?
So,
like
you
mentioned
that
the
those
top
four
metrics
are
available
at
the
project
level,
will
they
also
be
available
in
core
at
the
group
level?.
A
E
A
I
think
also
well,
you
need
to
remind
me
anything
because
you're
working
on
that
similar
issue
on
the
group
level
project
on
the
group
level
release
analytics,
did
we
put
that
in
core.
E
A
C
Okay,
should
I
move
on
to
the
the
premium
dashboard
that
we
talked
about
cool,
so
the
next
one
is
available
at
premium.
This
is
a
project
level
analytics
ci
cd.
We
still
have
that
dora
4
at
the
top,
just
like
we
did
for
core
users.
The
difference
here
is
that
we
are
now
introducing
this
door
of
4
tab
which
will
contain
all
the
door
4
metrics,
so
the
ci
cd
analytics
that
stays
the
same
as
what
it
is
now,
but
for
premium.
C
They'll
get
a
new
dashboard,
and
the
idea
here
is
that
for
each
of
the
door,
four
metrics
we
will
show
a
full
chart.
So
it's
going
to
be
that
metric
over
time,
starting
with
kind
of
hard
coding,
30,
90
and
180
days,
I
believe
and
then
being
able
as
a
post-mbc
idea
to
be
able
to
let
the
user
define
that
kind
of
time
line
a
little
more
effectively.
C
So
we'll
see
a
chart
for
deployment
frequency
we'll
see
one
for
leading
lead
time
to
change
time,
to
restore
service
and
change
failure
rate
right
now.
These
metrics
are
all
going
to
be
based
off
of
production,
and
that
is
a
hard-coded.
It
is
going
to
be
quote
per
prod
production,
I'm
not
sure
what
it
actually
is.
We
think
we
have
an
issue
right
now
to
make
it
something
more
flexible
and
then
the
long-term
goal
is
going
to
be
letting
users
select
what
environment
the
metrics
are
going
to
be
displayed
at.
A
Absolutely
so
we're
making
it
a
little
bit
more
flexible
now,
but
we
want
to
make
it
and
nathan
is
very
active
in
that
issue.
We
want
to
make
that
multiple
selection-
or
I
don't
know
somehow-
for
users
to
be
able
to
select
whatever
environments
they
want,
because
even
internally
in
gitlab
we
don't
use
production
so
at
least
for
dog
pudding.
A
I
would
like
to
start
with
something
so,
yes
we're
doing
it
iteratively
the
gitlab
style,
but
but
yes,
so,
at
the
end
of
the
day,
the
user
will
be
able
to
customize
the
timestamp
like
whatever
time
they
want
and
the
environment
some
additional
data
for
not
the
nbc,
but
a
little
bit
after
the
nbc,
like
vision
that
I
would
like
to
just
say
and
ian-
and
I
discussed
like
it's
really
hard
to
just
put
it
in
this
design,
so
I'm
just
going
to
mention
it
and
for
anyone
watching
this
video
later
so
so
we
know.
A
One
thing
is
that
I
would
also
like
us
to
have
on
these
charts
like
different
annotations
of
what
is
going
on
so
like,
for
example.
A
This
is
the
day
that
we
created
a
release,
or
this
is
the
day
that
we
closed
a
release
or
maybe
even
going
into
deploy
freezes
flags
going
on
and
off
like.
I
want
to
know
what's
going
on
in
my
system
in
order
to
understand
these
metrics
more
because
charts
are
great,
but
you
know
you
really
need
a
lot
of
background
information
to
know
like
what's
going
on
there.
So
annotations
is
something
really
nice
that
we
will
add
not
as
part
of
the
nbc
and
also
historical
data.
C
Test
results,
sorry,
random
question:
are
they
the
results
for
each
one
of
the
door?
Four
metrics,
or
are
you
hoping
for
a
user
to
be
able
to
download
the
dora4
report
and
get
all
the
metrics
in
one
whatever.
A
D
A
Yes,
it
takes
if
you're
deploying
through
the
back,
if
you're
not
deploying
through
gitlab
you're,
not
getting
these
metrics
but
we're
taking
the
internal
data
that
we
have.
We
added
an
api
in
the
previous
milestone
that
allows
you
to
get
to
fetch
the
data
and
what
nathan
is
doing
is
actually
presenting
that
data
into
the
ui.
So
you
can
get
this
data
both
on
ui
and
go
that
api.
A
You
can
import
it
into
an
external
system,
but
if
you're
doing
cd,
you
know
with
aws
code
deploy
or
with
finicker
or
something
else
you're
not
going
to
be
able
to
see
these
metrics
each
metric
is
defined
a
little
bit
different.
So,
for
example,
lead
time
for
changes.
We
define
this
as
how
long
it
takes
for
a
merge
request
to
get
to
get
merged
into
production.
A
So
again,
if
you're,
not
using
ci
you're,
just
using
first
control,
I'm
not
going
to
help
you
time
to
restore
service.
It
also
depends
if
you
have
deployments
through
gitlab
and
change
failure
rate
we
defined
it
by
how
long
it
takes
to
close
incidents.
So
if
you're
not
using
gitlab
incidents
at
the
moment,
you
really
can't
benefit
from
it.
I'm
sure
we're
going
to
need
to
add
additional
integrations
of
the
when
we
proceed,
but
not
part
of
the
nbc
at
the
moment.
E
A
Let
me
refine,
let's
just
be
a
little
bit
more
precise
for
dora
4
project
level
analytics
for
for
adorable
or
through
the
premium
user.
They're
not
going
to
be
able
to
see
group
level
dora
formations.
A
The
icd
metrics,
on
the
other
hand,
will
release
they
probably
can
so
just
duracore
for
ultimate
is
going
to
be
group
level.
The
idea
at
the
end
is
that,
since
the
majority
of
our
users
are
self-managed
they're
actually
going
to
want
instance
level,
I
didn't
define
it
as
part
of
the
nbc,
but
it's
probably
going
to
be.
You
know
the
next
task.
C
C
I
had
from
the
design
perspective
to
show
was
exactly
what
nathan
just
brought
up.
We
only
for
the
ultimate
tier
should
there
be
these
group
level
analytics
the
analytics,
look
the
same
in
the
design,
but
they'll
be
at
the
group
level
for
the
mvc
I'd
like
it
to
look
very
similar.
I
would
imagine
and
correct
me
if
I'm
wrong
as
a
post
mvc,
we
might
want
to
look
at
the
way
that
groups
are
managed
in
the
dashboard.
A
Yeah,
what
I
do
want
to
mention
here
on
the
ultimate
on
the
ultimate
dashboard
is
that
we
are
now
seeing
a
group
of
projects.
So
again
this
is,
it
doesn't
have
to
be
part
of
the
nbc,
but
I
do
want
to
kind
of
explain
the
broad
vision
in
a
similar
way
that
we
could
select
the
timestamp
and
the
environment.
A
A
A
So
when
I'm
talking
about
deployment
frequency
advocates
all
the
data
from
all
the
different
projects
and
shows
me
a
chart
based
on
the
aggregation
right,
but
maybe
we
would
also
want
to
see
side
by
side
or
line
graphs
where,
where
the
series
would
be
a
project
or
an
environment
or
a
group
or
you
know
a
different
different
ways,
but
you
would
want
to
see
like
the
deployment
frequency
one
as
com
as
a
comparison
view,
and
not
only
like
an
aggregation
view,
because,
as
I
mentioned,
if
we're
talking
about
the
executive
persona
that
we
were
interested
in
giving
them
this
capability,
they're
really
interested
in
seeing
how
their
groups
are
performing
and
nathan.
A
If
you
remember
when
we
way
back
when,
when
we
had
an
initial
discussion
in
the
dora
4,
we
kind
of
talked
about
gamification
in
dora
4,
so
just
for
the
uploaders
that
weren't.
In
that
conversation,
I
just
want
to
take
us
back
and
kind
of
explain
what
we
were
thinking
about.
So,
if
you
think
about
dora
for
the
instance
level
or
even
nicer
in
gitlab.com,
we
have
a
ton
of
data
that
others
don't.
So
we
have
a
bunch
of
different
projects
from
different
companies
and
we
have
all
this
aggregation
data.
A
A
I
don't
know
we
can
define
that
in
different
ways,
but
actually
see
how
you're
performing
versus
other
companies
would
be
really
really
interesting,
because
you
want
to
know
that
you're,
a
high
performer,
it
kind
of
gives
you
some
of
that
competition.
You
know,
juice
competitive,
you
know
flow,
and
so
we
were
even
thinking
of
doing
badges
and
even
I
think,
even
design
badges
for
that
to
kind
of
show
you
you're,
awesome
or
or
you
need
to
improve-
and
we
were
thinking
of
doing
like
something
similar
also
for
group
level.
A
So,
if
you're
really
interested
in
a
group
of
developers
or
several
software,
agile
teams-
and
you
kind
of
want
to
do
some
kind
of
you
know
competition
between
them,
you
can
show
how
amazing
your
team
is
versus
others,
and
it
could
be
really
really
cool,
but
definitely
not
part
of
the
university.
Just
you
know
part
of
my
wild.
A
E
So
one
more
question
about
this
again
kind
of
related
to
the
the
different
tiers
so
for,
if
you're
a
premium
customer
at
the
project
level,
and
then
you
upgrade
to
ultimate,
is
there
any
difference
in
the
project
level
page
or
would
those
be
ident?
The
only
change
in
ultimate
is
that
we're
adding
it
to
the
group.
A
Oh
again,
we're
doing
it
with
iterations,
so
we
kind
of
had
a
few
conversations
about
the
naming
of
the
tag.
If
you
remember,
and
so
we
were
going
back
and
forth
to
call
it
deployment
should
be
called
number
fours.
A
So
here's
the
thing
at
the
moment
for
what
we're
doing
now
we
added
three
different
charts
per
metric
for
each
time
set
and
we
need
to
so
so
we
have
several
approaches
that
we
we
can
do
this
in
terms
of
iteration.
A
A
So
we
can
do
two
things:
either
consolidate
the
view
that
we
have
today
from
three
to
one
having
this,
you
know
easy
way
to
navigate
between
the
charts,
because,
basically
we're
showing
the
same
chart
for
just
different
kind
of
sets,
there's
no
difference
in
the
charts
that
was
the
spanking
and
then
just
adding
renaming
the
tab
and
adding
the
metrics
one
by
one.
So
whatever
you
prefer
at
some
point,
we're
going
to
need
to
do
it.
A
So
whatever
is
easier
for
you,
if
it's
adding
a
tab
and
then
consolidating
you
know
we're
gonna
need
to
do
this
work
eventually.
So
I'm
gonna
ask
you
that
question.
What
do
you
think
is
the
best
way.
E
I
I
personally
really
like
the
look
of
these
mock-ups
right
here,
so
that
yeah,
I
don't
know
what
the
correct
path
is
toward
that,
but
that
that
makes
a
lot
of
sense
to
me,
and
this
gives
us
a
lot
of
flexibility
like
we
could
eventually
replace
that
30
90
180
button
group
with
like
a
custom
date
range
which
is
nice
like.
If
we
wanted
to
do
that
or
or
we
can,
we
can
filter
all
of
them
by
the
same
environment.
So
I
think
this
structure
gives
us
a
lot
of
flexibility
going
forward.
C
Also
thinking
about
ultimate,
as
wanting
to
be
able
to
compare
and
contrast
later
or
be
able
to
dive
into
specific
metrics
for
specific
problems,
if
we
condense
them
all
into
the
door
of
four
tab.
Now,
when
we're
done
with
the
mvc,
then
we
can
start
using
the
tabs
to
show
really
fine
detail
data
or
those
comparisons
and
stuff
like
that.
It
gives
us
more
flexibility.
Moving
forward.
A
Awesome,
so
if
we're
all
good
with
this
we'll
add
this
I'll
create
a
new
issue
to
consolidate
the
charts,
we'll
add
it
to
the
needs
weight
as
as
always
and
then
plan
for
the
iteration,
the
further
implementation
of
it.
Okay
and
then
we
can
move
forward
on
that.
There
is
one
more
thing
that
I
want
to
mention,
and
that
is
the
value
stream
analytics.
A
So
it's
analytics
team,
which
are
now
called
something
else.
Optimized
have
already
created
and
created
some
sort
of
dora
for
metrics
in
a
file
view
and
we're
not
showing
the
same
data.
So
I've
had
conversations
with
them
that
we
should
probably
align
to
share
the
same
data.
They
count
it
a
little
bit
different
than
we
do
so.
A
I
expect
that
we're
going
to
start
collaborating
closer
to
them
and-
and
we
kind
of
need
to
share
the
knowledge
between
the
two
teams-
we're
not
showing
exactly
the
same
things,
because
they're
they're
staying
at
final
view,
which
is
similar
to
what
we're
doing
in
core,
but
I
wouldn't
want
to
show
different
values,
value
analytics
and
in
the
cic
analytics.
So
since
they
don't
have
an
api,
I
think
it's
it's
more
flexible
to
use
our
solution,
which
is
how
we
started
out.
A
We
were
thinking
about
stealing
their
data,
but
there's
a
lot
of
limitations.
One
is
that
there
there
wasn't
an
api
that
we
could
have
used
and
the
other
one
is
that
it's
locked
to
production
similar
to
how
we
started,
but
we
quickly
decided
to
expand
the
api
at
the
least
and
then
maybe
even
allow
selection
of
any
any
environment
that
you
want.
So
we're
going
to
have
to
you
know,
consolidate
those
two
so
that
we're
showing
a
single
sort
of
this
truth
and
people
are
not
like.
A
Oh
wait
on
this
value
and
this
dora
4.
I
have
a
diploma
frequency
of
50,
and
here
I
have
75,
which
one
is
right
so
so
I
expect
that
work
to
also
be
in
addition
to
what
we're
doing
now.
D
For
it,
I
have
a
comment,
a
question
about
the
namings
of
the
tab.
So
the
left
tab
is
ci,
cd
analytics
and
the
right
tab
is
d4.
But
d4
is
not
part
of
scientific
analytics,
it's
kind
of
analytics
for
ci
cd
right
and
it
looks
like
a
different
thing.
There
is
icd
analytics,
and
so
maybe
something
with
the
naming
has
to
be
adjusted.
A
You
know
what
that's
a
good
point.
Maybe
we
should
call
the
tab
pipeline,
because
the
icd
analysis
kind
of
the
title
of
what
we're
going
to
see
and
at
the
end
of
the
day,
what
we're
actually
seeing
is
pipeline
statistics
and
then
dora
for
right.
E
A
So
should
we
just
rename
the
tab
to
pipeline.
A
And
then
we're
also
adding
the
release
ones
that
you're
working
on
right.
A
Well,
we
have
hayata
here
she
designed
the
release
one,
so
maybe
she
can
answer
to
that.
A
So
hyanna
nathan
is
working
on
an
issue
unrelated
to
dora
form.
It's
about
release,
metrics
that
we
wanted
to
present
on
the
I
think
it
was
on
the
group
level
right
then.
D
A
So
kind
of
like
I
think
it
had
to
do
with
like
really
statistics
how
many
releases
were
created
or
something
of
the
sort
does
it
make
sense
that
we
added
here
under
ci
cd,
analytics
on
a
separate.
E
Tab,
no
hannah,
it's
a
different
one,
I'm
just
responding
to
her
chat
message.
It's
it's!
The
group
level
statistics,
it's
it's!
How
many
releases
there
are
in
the
group
and
then
the
percentage
of
projects
with
releases.
B
B
I
think
would
be
interesting.
Well
if
the
scope
didn't
change
right
for
the
release.
Page,
I
think,
would
be
interesting
to
then
have
I
don't
know
a
shortcut
somewhere
in
the
release
page
where
I
can
link
the
users
here,
if
that's
the
case,
so
that
the
flow
doesn't
doesn't
change
that
much,
but
indeed,
if
you're,
showing
the
metrics
for
pipelines
for
releases
etc.
A
E
B
E
E
Yeah,
so
that's
what
I'm
working
on
this
milestone,
so
I
just
want
to
make
sure
that
this
basically
the
work
I'm
doing
here
isn't
wasted
like
we
have
a
place
for
a
vision
for
it
in
our
in
our
page.
So
I
I
think
that
if
we
add
like
a
releases
tab
like
we
showed
on
the
other
one,
that
would
make
sense
to
me.
B
Yeah
see
what
you
mean
now,
yeah,
thanks
to
me
as
well,
because
if
you
want
to
later
on
just
yeah,
add
more
information
more
analytics
related
to
releases.
Specifically,
you
already
have
a
place
and
if
not
it's
just
a
tab,
you
can
get
rid
of
it
easily.
A
I
think
we
could
probably
come
up
with
a
bunch
of
really
interesting
release.
Metrics,
like
how
many
issues
are
an
average
in
the
release.
How
many?
Mrs,
the
duration
of
a
release,
I
think
we
can
come
up
with
really
interesting
metrics
along
the
way,
though
it's
out
of
scope
for
mordor
for
discussion,
but
just.
B
But
this
is
also
interesting
from
like
a
release.
Page
perspective.
Writing
we
had
this
conversations
in
the
past
about
where
do
we
fit
all
the
data
that
we
want
to
show
related
to
releases?
B
Then
it
could
be
here
right
in
the
release
page,
you
have
the
overview
you
have
the
release,
notes,
etc,
and
then
you
link
to
the
analytics
and
with
this
detailed
view
of
the
stats
of
all
your
releases,
so
food
for
top.
A
Cool,
so
I
think
I
think
we're
aligned
there's
quite
a
lot
of
homework
to
align
with
all
the
different
issues.
I
don't
know
jack
and
I
went
on
an
opening
issue.
I
guess-
and
we.
A
With
some
of
the
guys,
so
here's
what
I'll
commit
to
at
some
point
I'll
have
everything
updated
but
I'll
make
sure
that
everything
before
the
milestone
will
be
updated
and
it
talks
to
the
right
design.
That's
okay,.
D
C
Also
add
the
designs
here
with
the
notes
that
we
put
together.
So
there
is
just
one
place
that
is
like
this
is
our
overall
vision
and
then,
if
there
is
a
discrepancy
between
an
individual
issue,
we
can
always
reference
back
to.
This
is
where
we
last
decided
we're
all
going,
so
that
might
also
make
it
a
little
bit
easier
for
you.
A
Yeah
the
update
I
sent
it
in
the
chat,
I'm
also
gonna,
add
this
recording.
I
think
it's
going
to
be
beneficial
for
not
only
our
group
for
others
that
want
to
understand
where
we're
going
with
dora
form
and
also
the
optimized
group.