►
From YouTube: SIG Instrumentation 20221110
Description
SIG Instrumentation Bi-Weekly Meeting Nov 10th 2022
A
Okay,
great
welcome.
Everyone
today
is
November
10th
2022..
This
is
the
bi-weekly
e-cig
instrumentation
meeting.
So
we
have
a
couple
things
on
the
agenda.
A
Okay,
well,
we
need
a
release.
Plan
for
metric
server
looks
like
America's,
not
here
either.
So,
let's
defer
this
to
next
week.
A
Do
you
want
yeah.
B
So
the
first
one
was,
you
know
this
is
one
thing
TSM
has
had
its
own
makes
sense
launch
it.
On
top
of
the
you
know,
the
metrics
being
exposed
so
that
you
know
they're
able
to
first
of
all
find
everything
under
one
kind
of
one,
and
it
would,
you
know,
really
help
them
if
they
want
to.
B
You
know
down
the
line
up
in
these
particular
set
of
others
to
whatever
they
are
running
in
their
own
cluster,
or
you
know,
visualize
them
in
a
dashboard
and
be
with
kind
of
you
know,
provide
that
to
them.
So.
C
One
one
second
prancho
hello,
sorry
I
joined
a
little
bit
late.
Your
mic
is
very
distorted.
I
can't
understand
what
you're
saying.
C
B
Okay
yeah,
so
mixance
is
basically
you
know,
a
set
of
alerts
and
dashboards
that
you
know,
projects
that
are
usually
working
with
metrics
expose.
So,
for
example,
if
you
have
a
operator
and
that
operator
has
some
meta
metrics,
so
you
would
want
to
have
them
in,
let's
say
have
a
have
a
dashboard
for
that,
so
that
folks
are
able
to
easily
visualize
that
in
a
grafana
in
a
dashboard
and
all
these
metrics,
you
would
have
alerts
on
top
of
them.
B
That
would
utilize
these
metrics
to
alert
whenever
there's
something
wrong
with
the
operator
yeah.
So
Damien
had
this
comment
and
Wiley
was
not
I.
Think
really,
plus
one
with
this.
He
kind
of
wanted
to
you
know
he
was
on
board
with
the
idea
of
instrumentation
owning
the
mixes,
that
for
all
these
sub
projects,
for
the
sub
projects,
that
not
all
but.
C
I
don't
know
honestly
I
think
we
would
need
more
information
like
would
you
be
able
to
give
us
a
short
proposal
and
like
share
it
with
the
mailing
list,
because
I
don't
I,
don't
really
understand
the
specific
code
that
you
want
to
put
where
and
that
kind.
C
We've
been
like
removing
mix-ins
right
like
there
were
a
bunch
in
kubernetes
kubernetes
and
we
were
spinning
them
out,
but
we're
like
not
even
I'm,
not
even
sure
that
those
were
all
finished
and
I.
Also
not
sure
who
is
maintaining
those
in
their
current
state
like
I,
think
they're
kind
of
not
really
maintained,
I
mean
I
could
be
wrong.
But
I
was
one
of
the
approvers
for
like
spinning
some
of
that
stuff
out
and
I.
Think
like
we
did
the
initial
migration
PR
and
then
they've
kind
of
gone.
C
Nowhere
and
I'm
not
sure
where
all
of
that
stuff
is
at
so
I'd
like
to
see
how
it
fits
into
the
wider
mixing
ecosystem.
I'm
not
saying
like
yes
or
no
I,
just
I
don't
have
enough
information.
A
I
I
mean
my
understanding
is
basically,
if
like
KSM
has
some
standard
sets
of
metrics
and
they
have
stable
metrics
and
specifically,
you
can
create
like
slos
from
these
things,
and
you
would
not
have
to
intersperse
that
with
metric
data
from
other
sources,
I
I
don't
see
why
that
would
be
necessary.
I
mean
like
at
most.
You
could
mix
them
with
metric
data
from
let's
say
the
cube,
API
server
but
I
believe
that's
basically
necessary
dependency
anyway,
so
yeah
I
mean
I,
think
I
think
it
makes
sense.
A
A
The
next
topic
is
also
Brown
Shoe,
which
is
enabling
discussions
on
the
repo
that's
already
been
enabled
by
the
way,
so
you
can
yeah
yeah,
not
sure
how
much
people
will
use
it.
Historically,
people
don't
seem
to
use
GitHub
discussions
that
much
but
I
guess
it's
helpful
since
there's
no
dedicated
Google
group
for
KSM.
C
A
Yeah,
so
the
next
one
is
sick,
instrumentation,
Shadow
program,
so
yeah.
What
exactly
would
you
like.
B
Yeah
there
was
an
AI
on
Damien
regarding
the
Google's
group.
You
know
coming
up
with
the
Google
flip
for
this
particular
thing.
So
that's
basically
what
so,
basically
all
of
these
points
and
all
of
the
experience
that
we
have
at
this
moment
is
based
off
of
what
Sig
enhancements
has
that
has
done
with
this
with
their
own
shadow
and
for
this?
Basically
they
they
have.
You
know
the
at
the
end
of
every
shadow
program.
B
They
have
this,
you
know
they
increase
the
member
list
and
you
know
for
the
folks
Who
deliver
and
then
they
again
you
know
roll
out
new
Google
forms
and
all
that
stuff
and
then
they
prepare.
The
set
of
you
know
major
features
that
need
to
be
that
need
to
go
in
so
I
was
thinking.
Maybe
we
can,
you
know,
start
talking
on
that.
B
You
know
start
it
rating
on
that
front
and
kind
of
you
know
start
so,
because
I
saw
you
know,
Catherine
and
I
have
been
contributing
for
a
while.
So
maybe
you
know,
if
down
the
line
we
can
become
members,
then
you
would
have
a
broader
force
and
we
can
have
you
know.
You
know
we
can
get
on
with
this
Shadow
program
and
you
know
start
assessing
what
what's
next.
For
this.
C
I
think
that
it's
a
great
idea
to
get
people
shadowing
and
whatnot
one
thing
that
I
would
caution
us
a
little
bit
on.
We
are
much
smaller
and
we
have
less
formalized
roles
within
Civic
instrumentation
so
like
there
is
a
lot
of
process
around.
How
I
think
someone's
at
Stig
enhancements
enhancements
is
a
subproject
of
Sig
architecture.
I
think
you
meant
stick
release
release,
has
the
release
team,
yeah
and
and
enhancements
is
part
of
it.
It's
confusing,
I
agree.
I
have
had
this
discussion
many
times,
but
they
have,
like.
C
C
Don't
want
us
to
necessarily
put
a
ton
of
process
on
the
maintainers,
because
that's
not
really
going
to
help
us
grow
people
within
the
Sig,
because
then
we'll
be
spending
all
of
our
time
dealing
with
the
process
as
opposed
to
like
actual
mentorship,
and
so,
if
there's
a
way
that
we
could
like
get
the
benefits
of
having
a
shadow
program
but
not
necessarily
go
through
the
whole
thing.
C
With
like
every
release,
we
have
a
form
and
then
we
have
to
go
and
select
shadows,
and
then
we
have
to
like
formally
onboard
the
shadows
and
blah
blah
blah
like
I
know
that
that
requires
a
lot
of
work
on
the
part
of
folks
in
the
release,
team
and
I.
Don't
want
to
sign
focusing
instrumentation
up
for
that
much
work
because
I
don't
think
that
that
will
have
necessarily
a
lot
of
bang
for
the
buck.
So
I
would
rather
see
like
hey,
let's
figure
out
how
like
I
agree.
C
A
B
Okay,
so
I
went
to
the
you
know
the
requirements
talk
and
said
that
I
need
two
sponsors.
So
I
wasn't
sure.
If
you
know
I
should
be.
You
know
asking.
C
Okay
or
it's
a
is
this:
a:
are
you
already
a
kubernetes
org
member.
A
C
D
And
so
I'm
and
I'm
new
here
and
I'd
I'd
love
to
to
contribute
to
to
instrumentation
and
see
and
I'm
already
a
kubernetes
member
and
I'd
like
to
know
where
I
can
help
her
and
I
already
started,
contributing
to
keep
State
Matrix
and
also
to
from
materials
adapter.
D
A
A
Metrics
or
any
of
our
sub
projects,
but
for
the
stuff
that
goes
in
kubernetes
buffer.
C
Yeah
I
I
would
say:
I,
don't
worry
too
much
about
that
you're
already
involved
in
places
that
you
know
aren't
necessarily
subject
to
those
free,
Cycles
I
will
say
that
there
is
absolutely
an
ebb
and
flow
of
contributors
throughout
the
years.
If
you
ever
look
at
some
of
the
dev
stats
graphs,
you
can
see
in
you
know,
sort
of.
C
As
there
is
like
a
northern
hemisphere,
winter
holiday
shut
down,
we
tend
to
see
a
lot
lower
contributions,
end
of
like
November
and
throughout
the
month
of
December,
but
realistically,
like
you
know,
just
just
work
on
some
stuff,
I.
Think
generally,
our
criteria
for
sponsoring
many
folks
in
Civic
instrumentation
are
happy
to
sponsor
new
orc
members
and,
like
the
bar,
is
not
super
high.
We
want
to
see
you
active.
We
want
to
see
you
want
to
continue
to
contribute.
C
If
you
are
interested
in
contributing
code,
I
believe
that
most
of
us,
like
definitely
the
bars
you
must
have
at
least
one
merged
pull
request.
I
like
to
see
a
few.
If
I'm
gonna
sponsor
someone,
they
don't
have
to
be
huge,
they
can
be
really
small,
like
the
extra
small
size.
Pr's
are
totally
fine,
but
you
can
read
more
about
the
proc.
The
process.
I.
Think
Han.
You
had
a
a
copy
of
the
contributor
ladder
open.
Maybe
we
could
link
that
in
the
minutes
and
the
chat
yeah.
C
Yeah,
so
this
explains
all
of
the
requirements
for
Community
membership
and
we're
really
excited
if
you're
interested
in
getting
involved.
I
know
it
can
be
somewhat.
You
know
confusing,
but
you
know
just
like
take
a
look
at
the
open
issues
and
PR's
on
projects
that
you're
interested
in
maybe
like
review
some
PRS,
maybe
you
know,
go
through
some
issues.
Submit
a
PR
for
a
small
thing.
C
It
doesn't
have
to
be
big,
could
be
typo
fixes,
preferably
not
like
large
type
of
fixed,
PRS
and
kubernetes
kubernetes,
because
those
rarely
get
merged
because
they're
hard
to
review,
but
definitely
like
you
know
and
reach
out
to
the
maintainers
in
the
sub
projects
that
you
are
interested
in
working
in.
So
if
you're
interested
in
Cube,
State,
metrics
I
think
there's
like
three
approvers
there,
including
Damien,
if
you're
interested
in
working
on
metrics
and
kubernetes
kubernetes,
there's
a
bunch
of
us
who
review
those
and
so
on
and
so
forth.
C
So
hopefully
that
gives
you
some
pointers
of.
Like
you
know,
the
guidelines
are
in
the
dock,
for
what
you
need
to
do
like.
We
mostly
just
follow
the
guidelines
within
instrumentation
and
then
who
do
you
ask
for
help
talk
to
the
approvers
in
the
places
that
you
want
to
contribute,
feel
free
to
reach
out
to
any
of
us
on
Slack.
A
Yeah
also,
if,
if
you
want
some
like
dedicated
mentorship
like
feel
free
to
just
ping,
me
directly
I'm
happy
to
schedule
some
time
and
walk
through
stuff
with
yeah
anyone
who's
willing
to
do
it.
Thank
you
cool,
so
the
next
we
have
about
10
minutes
left.
So
we
have
one
more
thing
by
Benjamin.
E
Yes
hi,
can
you
hear
me
yep
yeah?
Yes,
yes,
so,
basically
at
tubecon
there
was
a
demo
about
using
open
tracing
to
trace
cubelets
and
the
kubernetes
runtime
and
I'm.
Also
working
on
like
a
project,
research
to
reuse,
kernel,
tracing
to
trace
cubelets
and
the
kubernetes
runtime,
so
I
thought
it
would
be
interesting
to
basically
show
a
bit
about
the
kernel
chasing
because
it's
not
really
well
known
in
life.
A
E
A
Yeah
sure
this
sucks
hold
on
I,
don't
know
what's
going
on
here,
but.
E
E
A
program
on
like
certain
system
calls,
while
ltdng
is
more
about
like
recording
the
different
events
and
like
seeing
which
event
called,
which
and
there's
a
tool
called
Trace
compass
that
allows
you
to
like
analyze
the
kernel
trace
and
with
that
you
can
actually
see
the
critical
path
of
a
process
and
see
which,
with
with
which
other
processes
communicated.
So
in
the
case
of
the
cubelet
you
can
see
you
can
see
the
cubelet
actually
like
contact
tick,
contacting
container
d
to
basically
schedule
ads.
E
And
the
work
I've
been
doing
lately
is
really
adding
user
space
events
and
the
kubernetes
in
the
cubelet
source
code.
In
order
to
like
understand,
what's
happening
at
certain
times,
so
can
I
post
a
picture
in
the
deck.
A
C
Okay,
one
second,
let's
see
make
co-host.
E
E
Yeah,
so
basically,
there's
like
three
panels:
one
on
top
shows
like
the
the
control
flow
between
every
process
in
the
kernel
and
user
space.
E
Basically,
every
process
how
they
communicate
between
each
other
and
the
one
at
the
bottom
show
the
critical
path
of
like
the
cubelet,
and
basically
we
can
do
an
analysis
of
like
where
the
time
was
spent
and
like
on
which
process
it
was
waiting.
So
I
I've
put
some
annotation
on
the
basically
Gantt
chart,
and
here
you
can
see
basically
like
the
Zone
in
purple.
Is
me
using
Cube
CTL
to
like
start
the
to
to
apply
my
deployment.
E
Then
the
blue
Blues
only
is
like
the
the
pad
starting
up
and
in
the
middle
there's
like
a
orange
spot,
where
you
can
see
the
the
cubelet
scheduling,
basically
starting
up
a
count,
energy
processes
and
like
contacting
them-
and
you
can
also
like
compare
these
events
with
like
CPU
usage
and
memory
usage,
disk
usage.
So
in
case
of
like
latency
issues,
you
can
easily
diagnose,
like
the
reason
why,
like
a
certain,
startup
was
slow
like
on
which
process
it
was
waiting
for.
You
can
also
see
like.
A
We
could
export
this
stuff
to
the
interesting
framework
stuff
that
David's
been
working
on.
Okay,.
G
Sorry,
did
you
have
to
make
any
changes
to
the
cubelet
to
make
this
work,
or
is
this
entirely
outside
of
kubernetes.
E
E
C
G
And
one
one
more
question:
how
does
it
like,
let's
say
two
different
pods
are
started
at
once.
How
does
it
disambiguate
say
whether
pulling
an
image
is
associated
with
one
or
another.
G
E
The
way
I'm
doing
in
users
basically
associate
basically
I'm,
just
like
in
the
trace
I'm,
putting
the
uid
at
the
pad.
Okay,.
D
E
I
can
like
see
like
when
the
event
was
happening
for
each
stats
and
then
I'm,
just
looking
at
like
the
the
thread
ID
of
the
of
the
cubelet
on
which
it
was
running.
E
There's
actually
been
some
work
done
previously
at
my
lab
to
basically
combine
kernel
traces
with
open
tracing,
but
they
still
add
to
your
iq's
system,
calls
to
to
lttng
UST
to
basically
like
sync,
the
information
between
open
tracing
and
the
kernel.
G
C
F
Hi
Elena
nice.
C
F
F
C
Awesome
well
welcome
we're
glad
to
have
you
it's
great
to
see
you
working
on
PRS
and
yeah
I.
Think
it's
time
for
folks
to
drop
so
I'm
gonna
end
the
meeting
but
hope
to
see
you
all
soon
and
it's
great
to
see
everyone
cheers.