►
Description
Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2021 Virtual from May 4–7, 2021. Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.
A High-Schooler’s Guide to Kubernetes Network Observability - Drew Ripberger, Nirmata
The Kubernetes ecosystem provides fine attention to the use cases of almost all projects. At the same time, to a novice developer trying to break into distributed systems, Kubernetes can also be incredibly daunting at times. Kube-netc was a project developed by Drew Ripberger, a recent high school graduate turned summer intern at Nirmata. Kube-netc is built around creating all encompassing network observability. With eBPF capturing connection statistics and Prometheus exposing the processed metrics, kube-netc is a compelling example of how users can easily implement enhanced system awareness. Though prior to his internship, Drew had not used Kubernetes, or even heard of eBPF or Prometheus before getting assigned the project, this talk will take you through the creation of kube-netc and his journey from hacks and workarounds to utilizing everything that the CNCF ecosystem has to offer.
https://sched.co/ekA3
A
Hi,
my
name
is
drew
ripberger
and
today
I
would
like
to
take
you
through
my
journey
learning
about
the
kubernetes
ecosystem
through
the
eyes
of
network
observability,
so
to
get
things
started.
I
would
like
to
talk
a
little
bit
about
just
briefly
about
myself
and
give
you
perspective
as
to
where
I
started.
A
I
found
myself
now
as
a
computer
science
student
at
the
ohio
state
university
and
I
got
me
started
in
distributed
systems
through
science,
fair,
actually,
where
I
worked
on
a
project
looking
at
optimizing,
the
rafter
consensus
algorithm
and
then,
if
you
look
into
you
know
where
raft
is
applied,
you
see
it's
applied
in
fcd
and
then
that
is,
there
is
then
applied
in
kubernetes
to
replicate.
Do
some
replicated
state
management
and
replicate?
You
know
state
data
as
to
status
and
things
of
that
nature
in
pods
to
make
sure
everything's
synchronized.
A
A
I'll
be
honest,
that
was
basically
the
only
language
that
I
knew
to
be
I
knew
proficiently
and
that
I
was
comfortable
developing
software
in
so
I
applied
not
really
expecting
the
position,
and
they
have
actually
been
amazing
to
me
since,
and
I
have
loved
my
opportunity
working
with
them
and
developing
open
source
software
over
the
summer,
and
that
is
mostly
going
to
be
what
we're
talking
about
today.
My
experience
working
with
chimpaguardia
and
developing
this
tool,
kubenetzy.
A
And
just
a
quick
reprieve,
jim
is
actually
giving
a
talk
with
some
people
from
vmware
alibaba
and
google
about
the
multi-tenancy
working
group.
So
definitely
go
check
that
out,
if
you
haven't
already
for
for
new
nemata,
but
the
project
that
I
was
working
on
over
the
summer
was
kubernetes
and
as
the
project
was
presented
to
me,
it
was
an
eppf
based
kubernetes
network
monitor
deployed
as
a
daemon
set,
and
I
am
going
to
be
honest.
I
didn't
understand
any
of
these
words.
A
But
really
what
is
the
goal?
And
why
were
we
trying
to
develop
this
in
the
first
place?
Well,
we
were
looking
to
create
a
tool
to
get
a
better
sense
of
what
was
happening
in
the
cluster.
We
were
looking
to
getting
to
get
all-encompassing
networking
statistics
at
the
very,
very
base
layer,
so
how
much
traffic
is
going
in
and
out?
Where
are
things
happening
and
what
are
causing
these?
What
are
causing
mass
what's
causing
this
traffic
and
using
prometheus?
This
would
give
us
very
easily
interpretable
to
interpretable
statistics
to
be
visualized
or
processed.
A
However,
we
want
it
upstream,
so
this
tool
is
open
source.
However,
it's
very
would
be
very
easy
for
an
enterprise
solution
to
process
these
statistics,
in
whatever
they
they'd
like
really
and
as
you're
going
to
see
the
really
the
goal
is
since
it's
all
encompassing
is
we
want
it
to
be
simple?
We
want
to
drag
and
drop
solution
that
somebody
can
easily
use
to
get
a
better
idea
of
the
state
of
their
cluster.
A
A
Then
I'm
going
to
give
you
a
quick,
quick
overview
of
kubernetes
how
we
tied
all
these
different
components
together
and
then
we're
going
to
demo
it
and
I'm
going
to
talk
just
briefly
at
the
end
about
what
I
took
from
this
experience,
because
it
was
a
really
really
incredible
journey
for
me,
knowing
nothing
about
kubernetes
or
the
cncf
ecosystem,
to
actually
being
able
to
build
an
open
source
project.
And,
speaking
with
you
today,.
A
So
start
off
we're
gonna
talk
about
ebpf,
which,
if
you're
not
familiar
with,
stands
for
the
extended
berkeley
packet
filter
and
this.
While
this
might
sound
like
a
very
big
just
a
jumble
of
mishmash
of
words,
it's
actually
not
as
complicated
as
you
might
think,
at
its
base
and
its
most
basic
level.
A
It
is
a
byte
code
that
runs
in
the
linux
kernel,
so
you
can
run
sandbox
code
very
safely
to
interact
with
any
process
that
might
be
happening
in
the
background,
or
really
do
just
about
anything
inside
of
the
linux
kernel
which,
if
I
don't,
if
you
haven't
heard
of
it,
yet
might
just
immediately
hit
you
as
being
very
powerful
just
as
of
now,
even
though
it's
a
rather
new
technology.
There
are
implications
of
networking.
Observability
security,
for
instance.
A
Psyllium
is
a
big
as
big
user
of
eppf
in
the
observability
observability
space
and
falco
and
security,
and
really
much
more
as
you
can
imagine.
There
are
really
endless
possibilities:
endless
possibilities.
What
you
could
do
with
such
a
modular
system
and
how
do
we
implement
the
epbf?
Really?
What
you're
going
to
do
is
either
write
ebb
of
bicode
or
probably
you're,
going
to
write
a
subset
of
c
called
bcc,
which
is
maintained
by
io
visor,
I
believe,
started
at
netflix.
A
A
It
was
really
really
interesting
journey,
trying
to
figure
out
where
to
find
all
the
necessary
documentation,
and
he
helped
me
come
up
and
figure
out
interesting
bug
that
came
up
with
newer
versions
of
the
linux
kernel,
so
he's
really
absolutely
an
expert
with
this
stuff.
So
if
you
would
like
to
learn
more,
I
would
definitely
recommend
attending
his
talk
beyond
the
buzzwords
bpf's,
unexpected
role
in
kubernetes,
which
is
actually,
I
believe
just
later
today.
A
A
So
the
next
part
of
kubernetes
was
the
prometheus
aspect.
This
was
going
to
play
into
how
we
visualized
and
saw
these
statistics
after
we,
we
obtained
them
with
this
ebpf
fps
and
I'll
talk
I'll
talk
more
when
we
get
to
the
cube
nancy
part
about
how
we
tied
these
all
together,
but
some
of
the
main
points
that
you,
you
should
probably
know
if
you
do
not
know
already.
I
know
prometheus
is
a
very
popular
project
inside
the
cncf
landscape,
but
just
to
give
you
a
quick
idea.
A
A
So,
as
you
can
see
in
the
in
the
bottom
right
here,
a
very,
very
popular
method
of
understanding.
The
statistics
that
are
that
are
exported
and
the
metrics
are
the
metrics
that
are
exported
by
the
but
prometheus
is
by
importing
them
into
grafana.
And
what
graffana
allows
you
to
do
is
allows
you
to
create
these
dashboards
that
monitor
and
scrape
your
prometheus
endpoint.
A
That
is
implemented
into
your
code,
so
say,
scrape
every
five
seconds,
pull
current
call
the
say:
pull
the
current
bytes
in
from
a
certain
ip
and
then
you're,
going
to
graph
them
and
you'll
be
able
to
see
else.
Traffic
and
visualize.
I
mean
really
whatever
you
want,
which
makes
prometheus
a
very,
very,
very,
very
interesting
manager
of
time
series
data.
A
A
A
So
here
is
how
I
visualize
generally
kubernetes
in
my
head.
So
say
you
on
the
left
are
a
user
and
you
need
a
way
to
take
this
configuration
this
state.
I
want
to
put
this
cluster
and
these
resources
in
and
you
need
a
way
to
automatically
manage
that
have
a
tool
that
automatically
partitions
the
resources
in
a
meaningful
way
that
you
know
elegantly
manages
this
this
state,
so
what
kubernetes
is
going
to
do
is
going
to
take
it.
A
It's
going
to
take
its
stamp,
it's
going
to
stamp
out
the
state,
and
it's
going
to
put
say
pod
one
and
node
one
pod,
two
and
node
two
and
that's
great.
You
have
this:
the
exact
state!
You
wanted
the
specified
in
this
config.yml,
but
things
don't
always
go
as
elegantly
as
that
and
say
pod
or
no
two
just
dies
or
something
happens
to
it.
Kubernetes.
A
This
is
where
kubernetes
shines,
because
what
kubernetes
is
going
to
do
it's
going
to
see?
Oh,
it's
gone,
but
we
still
need
to
maintain
this
state
that
the
user
wanted.
So
even
though
we
don't
have
two
nodes
now
we
still
need
to
maintain
these
two
pods.
These
two
containers
that
the
user
wanted.
So
what
we're
going
to
do
is
we're
just
going
to
push
pod
2
into
node
1,
because
there's
probably
a
rather
crucial
service
that
is
in
part
2..
A
A
What's
trying
to
be
told
and
said,
it's
not
very
self-documenting.
So
when
you
can
use
comments,
use
comments
but
definitely
use
some
examples,
and
if
you
want
to
develop
your
own
specification
or
configuration,
I
would
definitely
start
with
a
configuration
that
already
exists.
Maybe
pull
a
yaml
from
an
open
source
project.
A
I
know
a
big
inspiration
for
sort
of
the
structure
and
some
of
the
interesting
parts
that
I
was
having
trouble
with
were
pulled
and
referenced
to
some
celium,
some
ceiling
of
yaml,
because
they
also
used
damon
sets,
and
it
was
a
good
idea.
It
was.
It
was
a
good
way
of
getting
a
good
idea
as
to
how
they
structure
things
and
the
necessary
parts
of
the
ammo
that
are
going
to
need
to
be
there.
A
A
Just
to
give
you
a
brief
overview
of
kubernetes
of
kubernetes
before
we
get
into
the
demo
and
a
bit
more
detailed,
look
at
its
components,
I
would
highly
recommend
checking
out
the
the
github
repo
there's
some
basic
install
instructions.
If
you
would
like
to
check
out
and
try
it
for
yourself,
it's
quite
basic.
It
shouldn't
take
you
more
than
a
minute
or
two
to
get
things
up
and
running.
There's,
like
I
said,
there's
a
grafana
dashboard
supplied
along
with
all
of
the
the
code
in
the
repository.
A
So
if
you
just
want
to
install
it
really
quick
and
point
your
grafana
and
point
grafana
to
it
to
the
promethean
point,
you
should
be
great
and
you
should
be
able
to
see
all
of
your
your
clustered
traffic.
It's
very
very
it's
quite
simplistic!
So
really
kubernetes
one
of
his
goals
for
kubernetes
was
simplicity.
So
really
it's
a
great
start
for
new
contributors.
So
I
highly
recommend,
if
you're
new
to
the
cloud
native
compute
landscape,
I'd
highly
recommend
giving
some
issues
here
on.
Look
I'd
have
on
this
next
slide.
A
A
It's
about
a
four
minute
read
not
too
long
but,
like
I
said,
there's
really
some
great
starter
issues
here.
If
you're
new
and
you'd
like
to
get
involved.
These
are
just
some
small
enhancements
that,
through
their
gemini's,
calls
that
we
we
came
up
with
and
some
things
that
we
decided
that
we
might
want
to
implement
in
the
future.
A
So
definitely
I
highly
recommend
checking
out
the
issues
here
so
just
to
give
an
overview
of
how
we
each
how
we
used
each
of
the
different
components
in
the
description
technologies
that
I
I
talked
about
briefly.
There
are
three
main
packages
that
make
up
the
the
binary
that
is
deployed
across
the
cluster.
A
A
We
can
see
over
time.
How
does
this
connection
what's
happening
with
this
connection?
Are
we
seeing
a
lot
of
traffic
from
this
one,
this
one
ip
this
one
service
and
that's
where
we
also
see
some
help
from
the
kubernetes
api,
because
what
the
collector
does
is
whenever
it
sees
an
ip
being
reported
from
the
tracker,
it
looks
and
queries
kubernetes
and
it
says:
is
there
an
ip
or
is
there
a
service
with
this
ip?
Is
there
a
node
with
this
ip?
A
A
A
So
what
we're
going
to
do
is
we're
going
to
use
the
applied
that
was
on
the
readme
to
just
quickly
install
the
daemon
set
into
our
cluster.
You
could
use
the
the
install.yaml
that
is
found
in
the
source
or
you
could
just
use
this.
This
is
much
quicker
if
you
just
want
to
get
get
it
started
and
give
it
a
quick
try.
A
A
A
So
now
we
can
go
ahead
and
curl
the
metrics
endpoint
that
is
actually
running
in
our
in
our
kubernetes
cluster
and
read
all
these
prometheus
stats
and,
as
you
might,
you
might
understand
here,
these
aren't
very
useful.
It's
fun
to
see-
and
it's
some
maybe
nice
information
that
includes
you
know
different
statistics
about
yeah
the
network,
but
also
some
information
about
where
you
know
the
source
and
destination
the
namespace
that
they're
in.
A
But
that's
not
really
all
that
helpful.
We
don't
have
to
keep
looking
through.
All
of
these,
we
can
get
a
little
bit
better
of
an
idea
of
you
know,
specifically
the
ins
and
outs
if
we
use
just
maybe
quickly
grip
something
so
we're
going
to
quickly
grab
bytes
received
pipe
it
into
grab
and
look
at
bytes
received.
A
A
Oh,
it's
coming
from
a
it's
going
to
a
pod.
The
destination
is
cube,
controller
manager,
true
cluster
and
a
bunch
of
different
labels
about
the
kubernetes
environment
that
it
is
in
now.
This
is
very.
This
is
interesting,
but,
as
you
might
want,
this
is
extensible
and
you
can
always
pipe
this
into
grafana
like
I
said
we
won't
be
done
with
that
today.
Is
it.
A
You
know
sorry,
the
name
of
the
object
and
twice
per
second
and
whatnot,
and
it's
the
number
of
connections
so
yeah.
This
should
hopefully
give
you
a
quick
look
at
what
kubernetes
does.
Even
though
it's
a
bit
simple,
I
do
believe
that
you
know
some
a
bit
more
love.
It
can
grow
to
be
a
helpful
networking,
observability
tool.
A
So
that
was
just
a
quick
demo
of
some
of
the
functionality
of
kubernetes,
along
with
some
of
the
ebpf
code
that
was
utilized
to
create
it.
But
now
I
want
to
go
into
some
of
the
takeaways
and
what
I,
what
I
really
learned
and
gained
from
this
experience,
developing
open
source
software
over
the
summer,
so
big
one
here
open,
source
and
cloud
native
community
foundation
projects
are
for
everyone
at
a
high
level,
they're
real,
really
just
not
that
hard
to
to
grasp.
A
I
recommend
everyone,
if
you're
unfamiliar,
just
take
a
look
and
really
learn
by
doing,
though,
and
what
I
mean
by
that
you
don't
absolutely
need
to
you:
don't
need
to
develop
the
next
network,
observability
application
to
learn
from
them
just
creating
a
deployment
or
using
kind
to
start
up
a
daemon
set
like
that.
It
really
is
the
best
way
to
start
learning
about
these
different
tools.
That'll
absolutely
benefit
you
in
a
professional
or
just
a
learning
environment.
A
But
if
you
can,
I
would
absolutely
recommend
you
know
contributing
to
these.
These
projects
leverage
your
open
all
the
open
source
code
that
has
been
written,
and
you
know,
do
your
best
to
create
something
that
is
maybe
just
for
fun.
If
you
want
to
contribute
to
any
of
the
cloud
native
projects,
absolute,
that
is
one
of
the
best
ways
you
can
possibly
learn,
and
it
is
one
of
the
most
beneficial
to
the
ecosystem.
You're
supporting
open
source
software
you're
supporting
the
entirety
of
you
know
anyone
using
cloud
native
apps
really.
A
So
that
brings
me
to
my
end
here.
I'm
absolutely
would
love
taking
more
questions.
You
know
at
the
q,
a
here
or
slack,
just
send
me
a
message
or
you
can
send
me
an
email
here.
You
can
see
me
see
me
my
github
profile
drew
rip.
Also,
absolutely
I
would
definitely
recommend
looking
at
armada.
They
have
some
great
open
source
tools
on
github
available
major
one
caverno
doing
some
policy
management
see
them
on
twitter
and
their
website.