►
Description
Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io
Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects
Network Bandwidth-Aware Kubernetes Cluster - Yifeng Xiao & Yang Yu, VMware
Currently Kubernetes scheduler only considers cpu and memory but with network bandwidth oversubscription widely exists in the data centers, bandwidth contention is a big problem for bandwidth sensitive applications. With Kubernetes commonly deployed in a virtualized infrastructure like vSphere or OpenStack, network information at Kubernetes worker node level is not enough. If we want to guarantee those special applications won't get blocked anywhere in a cluster, we need to reserve network bandwidth for worker nodes in the whole cluster and use that information in the algorithm of scheduler. In this proposal we will not only demonstrate an approach to extend the default Kubernetes scheduler to an external service to make better placement on network resources, but also introduce a method to ensure ongoing network bandwidth for critical applications.
https://sched.co/NrnJ
B
C
A
I
come
from
real
work
and
now
I
as
the
stability
customer
and
before
that,
though,
the
way
marry
a
portable
heater
and
adult
versions
of
one
that
will
be
aware
in
your
health
and
is
taxed
in
from
their
big
data
institution
and
I
provide
system
attacks,
Adrenaline's
high
in
case
yeah
I
also
come
from
wealth
and
wires
of
China
are
indeed
original
Beijing
or
face
so
I.
What
I
do
is
not
working
on
my
mark
Renata's
products
and
not.
A
Focused
on
all
nutrient
Copas,
that's
not
working,
so
it
is
quite
well
as
its
inner
workings
of
how
any
questions
or,
if
you
have
any
topics,
an
ability
to
not
working,
do
not
be
as
disinterested
they
also
for
our
today's
agenda
are
going
to
talk
about
your
today's.
The
components
and
extender
schedulers,
as
well
as
the
quality
of
my
service,
and
some
of
the
network
features
no
fanatics
and
not
also
are
going
to
talking
about
how
to
enable
at
work
in
a
bank
best
clothes.
B
B
B
A
At
least
a
lot
of
advantages
of
Nakuru
nowadays
in
dreams,
no
from
a
scalability,
a
coverage
to
five
in
the
thousands
and
then
thoughts,
internet,
300
sources,
containers
and
the
river
keep
increasing
and
and
also
it
can
provide
men
separation
of
the
resources.
So
it
can
easily
realize
the
multi-talented
application.
A
A
The
two
elbows
race
and
class
communications,
the
after
the
network,
no
policies
and
according
and
math,
is
an
oxalate
and
domain
sness
for
the
server
and
thus,
first
of
all,
lucas
Granada
standard
scheduler
also
can
see
from
this
chart
shows
that's
the
Cooper,
how
O'byrne
attics
in
the
truce
and
the
notion
of
reports
and
how
to
do
the
scheduling.
So,
first
of
all
engineered
awareness,
there
is
no
of
the
filter,
so
the
purpose
is
to
filter
out
an
inappropriate
nose.
So
here
I've
enlisted
mystery
filter
born
in
the
filters.
A
A
So
there
is
actually
in
the
candidate
list.
So
the
Englishmen
are
not
in
a
world
of
hurt
or
out
of
this
scanning
dozen
at
least,
and
the
second
is
CPU
and
the
memory.
So
if
there
is
no
sufficient
view,
memory
and
the
Lord
will
be
further
and
out,
and
also
on
the
specifics
and
notes
and
then
probably
misses
him
in
the
labor,
there
is
no
the
matter
level.
The
normal
well
before
turnout
and
the
second
is
absent-
is
arrest.
A
No
no
will
be
score
and
the
ranks
and
said
there
was
several
additional
to
follow
the
first
one
is
not
replicas
distribution,
memories
even
or
not,
and
another
ranking
principle
is
the
utilization
of
the
Lord
and
also
wouldn't
you
check
now
whether
the
resource
negotiation
is
now
balanced
or
not,
and
one
earlier,
not
in
principle,
isn't
an
affinity
and
determinants
and
priority,
and
then
the
highest
ranking
note
will
be
selected
and
an
opponent
will
be
deployed.
Look
at
in
income
earner
DS.
They
are
three,
no
cordial
from
the
service
new
classes.
A
First,
one
is
not
guaranteed.
Guaranteed
means
when
request
is
a
goes.
Natural
element.
Angling
were
all
said
in
a
nap
and
in
a
basement,
resumption
of
will
be
appointed
as
the
highest
priority
and
in
a
second
mas
is
first
bow.
So
that
means
new
ready
fielding
to
request
and
limiting,
however,
requires
a
smaller
than
the
most
necessary
resource,
not
beyond
the
limit,
and
the
last
time
is
the
best
effort.
That
means
it
is
not
only
in
a
request,
so
it
can
only
guarantee
the
residue
resources.
B
A
Here
are
several
members:
the
sorts
of
applications,
for
example
all
of
the
new
IP
telephones,
no
applications
and
the
emails
and
Ramon
also
online
gaming,
as
well
as
Novell
servers
and
so
for
all
of
the
recent
applications,
the
infinitely
Haffner
to
deploy
days
on
the
more
that
burns,
the
sufficient
bandwidth.
We
also
have
not.
A
You
guarantee
the
very
load
now
working
the
latencies
and
very
international
traffic's
in
the
past
away,
and
to
not
ask
my
colleagues
just
emotion
that
there
were
some
sensitive
applications
and
into
the
bedroom
of
us
there,
for
example,
some
telecommunications
and
applications
internal.
Also,
we
have
to
consider
that
she
named
the
currents
in
the
community
of
kubernetes.
There
is
no
no
opens
and
accompany
solutions.
A
C
A
A
So
many
things
are
plugging
and
provide
the
native
ingress,
so
you
can
actually
define
ingress
and
a
virus,
often
natively
and
a
service.
A
I
belonging
is
not
going
to
appointed.
You
were
interested
to
the
IANA
point
and
to
identifies
the
responding
port
in
and
also
the
community
has
been
talking
about.
A
The
Mori
and
the
support
and
matters
is
a
means
which
is
provided
in
a
fire
from
a
and
hotels
the
motifs
and
as
well
as
networking
service
in
the
mesh,
and
not
all
of
the
managers
can
help
us
to
stove
with
the
motive
all
in
an
IC
features
and
because
number
D
fortunate.
We
know
that
missing
not
only
have
number
one
and
Isis
who
never
was
this
in
the
new
types
of
missing
I'm.
A
Looking
within
supportive
organized
internal
show
for
the
native
know,
we
have
for
the
now
worker
policy
so
which
can
open
us
to
defined
in
our
policy
resource
internet
to
provides
in
the
micro
segmentation
for
ports
and
another
one
is
also
frequently
Singh
is
the
service
image.
It
can
provide
a
seven-layer.
C
A
A
A
The
virtualized
that
infrastructure
is
never
ready
for
solve
the
problems
of
the
network
performance,
for
example,
we
can
use
a
PCI
passes
through
Internet
to
passes
through
Internet.
The
heart
know
we're
all
in
the
house
in
ocean
working
is
nice
ROV
and
net
to
do
some
improvements
now
as
the
network
performance
and
from
awaken
our
own
short
engine
and
used
virtual
switch
hardware
acceleration
to
help
us
not
to
improve
network
performance
and
the
similarly
for
VM.
A
If
we
want
to
solve
this
an
issue,
we
have
to
rank
applications
now
within
the
consumer,
and
we
have
to
have
the
same
considerations
so
the
basics
in
the
discussions
making
our
community
Nandina
are
actually
in
to
toast.
The
first
solution
is
not
revised
blogging
and
if
you
check
the
intel
and
bottom
layers
development
they
talking
about
DK
plugging
they
talking
about
ninja
logging,
so
those
are
all
device
plug
in
the
best
aimed
issue
allowed.
B
A
Approach
introduced
hardware
resources,
so
if
now
we
want
to
let
you
improve
the
network
performance,
this
is
actually
then
Solutions
Network
and
considers
device
now
blocking
can
actually
match
the
hub
work.
Hardware
resources
was
container
in
another
way,
is
the
magnet
villain
and
now
we
can
actually
loves
the
port
to
leverage
the
ocean
of
the
containers
and
directly
looseness.
A
Those
are
just
some
discussions.
Knitting,
however,
and
you
know
we
are
going
to
propose
another
solution
which
Norwegian
is
analysis
not
on
the
previous
slide.
Internal
network
user
requirements
is
not
our
recommendation.
We
think
now
in
a
bonus
in
there's
no
way
we
can
actually
provide
in
a
sufficient
in
a
national
working,
a
solution
for
ports,
not
from
difference
of
Raman
and
more
comprehensive
demotion.
A
A
A
So
that
means
no
HTML
worker
knows
we
have
to
reserve
the
Solutions
Network
nap
and
rest
sufficient
of
resources
in
abundance
and
we're
also,
when
it's
not
to
to
ingress/egress
the
conclusion
on
the
post.
Internet
ingress
is
the
video
and
the
egress
is
the
ocean
of
poot
internet
also
informational
for
coburn
attics
Federation's
were
also
need
and
that
you
take
the
network
and
resource
to
go
to
the
consideration,
so
the
prioritize
ur
and
in
a
future
it's
going
to
be
considered
rated
in
the
terminal
calculation.
B
A
On
the
physical
level,
the
bare
marrow
deployment
and
and
as
you
can
see,
already
have
enough
quite
an
effect-
the
physical
and
I
see
so
since
the
ban,
West
is
a
quite,
the
things
would
manage
to
reserve
any
other
extra
spaces,
and
you
know,
however,
we
need
to
know
to
conduct
an
ingress,
egress
control
own
plot
internal
already
have
a
Linux
traffic
control,
which
is
actually
not
reshaping
a
cube.
So
this
is
actually
didn't
I
see
so
for
each
grantee
napot,
and
you
know
there
is
branch
and
each
burst
about
portion
and
having
a
branch.
A
So
the
bassinet
efforts
port
engine
is
the
share,
is
not
one
branch
international
with
these
gathering
and
deployments
and
is
going
to
in
the
issues
and
then
is
going
issues
Francis
antenna
so
that
guarantees
in
a
pod
is
going
to
deploy,
according
to
the
request
to
guarantees
and
all
traffic
in
a
will
be
sent
out
and
for
the
first
of
all
pause
antenna
since
requesting
them
is
a
smaller
than
a
limit
international.
They
want
to
guarantee
that
the
request
will
be
satisfied.
C
B
B
C
Connected
to
the
part
through
an
S
I
guess
the
MP
and
setp,
and
to
set
up
the
fireworks
and
in
a
worker,
knowledge
you
can
see,
we
can
manage
the
traffic,
but
the
management,
traffic
and
I
did
in
traffic
are
separate.
All
of
the
paths
had
been
connected
to
over
us
and
there
is
a
specific
network
akkad
connecting
OVS
aware
that
and
then
VD
s.
So
with
this
kind
of
architecture,.
C
B
B
B
B
C
C
Notes
with
on
available
resources
will
be
excluded
and
rest
part
of
the
notes
will
be
squashed,
and
then
we
can
select
that
notes
which
the
highest
is
all
and
then
we
can
find
a
part
to
it.
And
then
and
as
X
note
agent
will
watch
this
week
and
I
know
and
as
X
will
register
the
part
and
it
will
tell
departure
much
spent
with
it
needs
and
then
reserves
event
within
the
watch
sweater.
B
C
And
as
acts
feature,
that
is
IO
control,
we
can
sad
the
same
share
for
each
of
the
note
and
she
means
priority.
Wait
when
there
is
a
traffic
jam
in
a
network
in
New
Jersey,
the
better
priority
and
in
a
virtualization
or
in
acknowledged
it's
not
about
the
running
of
the
communities.
It's
also
that
all
of
the
other
applications.
A
B
B
A
C
C
There
is
a
requester
food
reserved
event
with
one
option
is
to
use
the
cluster
API,
just
as
we
had
introduced
in
the
morning.
There
is
a
management
master
API
which
had
been
running
an
edge
under
just
a
control
plan
at
play,
and
then
you
can
define
what
the
process
look
like,
based
on
different
cloud
providers
and
in.
B
C
A
C
Kind
of
mechanism
is
cluster,
which
is
running
on
the
VM
and
what
cannot
be
made
into
what
you
have
been
desiring,
and
this
is
also
about
and
we're
in
charge
of
how
to
define
a
workload
of
provider,
and
there
is
a
property
about
the
bandwidth.
When
you
had
a
dedicated
bandwidth
and
a
cloud
provider
such
as
the
v-square
provider
can
perceive
that
there
is
a
bandwidth
property
and
then
we
will
call
the
relevant
interface,
and
today
the
Vienna
can
be
searched
into
specific
event
was
so.
C
B
C
B
B
B
B
C
A
C
C
B
B
C
B
A
B
A
B
A
B
B
B
B
C
C
B
B
C
B
B
A
B
B
A
A
Call
it
a
total
disrespect.
The
request
of
this
not
well
Jasmine,
Aston,
I,
just
a
mission
that
our
banner
was
mystical
power
circle.
So
we
were
creating
a
portrait
of
when
you
are
doing
a
poll
request
you
have
to
guarantee
fukinawa
in
this
indication
is
necessity
hundred
I,
don't
know,
however,
when
you
are
actually
ran,
who
is
in
the
pot,
and
you
are
running
as
an
axe
in
the
very
low
worker
node,
so
your
network
traffic
is
so
don't
that
because
we
want
to
guarantee
the
performance.
A
Odd
is
the
repressed
that
will
want
to
satisfy
your
requests,
and
I
cannot
become
present
here
without
understanding
without
knowing
that's,
not
one
will
be
the
new
traffic
from
The
Times.
They
only
deployment
according
to
become
Christ
and
ago.
I
cannot
make
sure
that
another
alternate
during
the
patron
time.
I
cannot
not
really
make
sure
the
performance
of
another
post.
So
the
what
we
do
in
here
is
a
problem.
C
A
Hope,
Americans,
the
max
and
minimum
common.
Yes,
the
total
ban
on
wasn't
animating
all
the
colorful
gatherers
are
wealthy,
announced
no
way
a
smaller
until
II.
So
that
means
I,
don't
know
the
schedule
a
number,
but
you
never
I
cannot
make
sure
that
I
can
guarantee
on
a
reservation.
So
this
is
the
solution.
This
is
procedure
will
take.
A
B
C
A
I
couldn't
tell
you:
that's
I
can
find
universe
model
resolution,
because,
if
you
guarantees,
then
you
probably
need
to
consider
that
you
are
first
of
all
and
the
past.
Whenever
I
mean,
if
not
I
can
make
the
every
source
and
locations
no
reason
I'm,
making
an
ice
water,
and
then
that
is
really
good,
but
by
far
there
is
no
way
for
us.
I
mean
no
sir,
yes
Nana
for
asana
to
finds
in
a
better
way.
So
basically,
this
is
in
our
solution.
C
A
Because
you
know
when
you
are
making
internal
your
requests
internal,
when
you
identify
your
requests
now,
we
all
know
therefore
cause
a
container
it
changing
a
lot
changing
all
the
times
internet.
So,
since
I
do
not
remember,
they
know
your
world
mellowed
and
I.
Don't
know
that
your
history,
that
it
can
be
used
as
a
stress
hold,
oh
I,
don't
know
whether
you
ever
considered
not
to
use
them
or
us
now
as
a
way
of
no
training.
Well,
yeah
I
mean
yeah.
B
A
And
so
I
can
train
it
uses
to
to
the
training.
Yes,
I
mean
you
can
probably
check
your
historical
data
of
your
abandon
averse
deployments.
P
I
agree
with
you.
We
actually
consider
this
kind
of
an
approach.
So
probably
we
can
use
some
very
smart,
AI
or
ism,
and
so
maybe
not
you
know,
for
the
application
of
the
networking.
I
will
actually
try
to
use
the
error
results
in
the
tubing
use
now
on
the
public
McLeod
and
you
know,
we've
actually
tried
the
CPU
memory.
A
Estimation
and
random
work
a
lot
of
them
similar
algorithm,
but
if
we
can
apply
this
kind
of
algorithms,
nothing,
it's
kind
of
an
abandoned
old,
Wiseman
domain,
because
no
by
far
we
know
that
my
son
is
a
very,
very
big
about
Annette.
Henderson
are
often
are
thousands
column
for
I.
Don't
know,
I'm,
not
sure,
really
sure
whether
it
is
methods
on
whether
it
is
the
meaningful
for
a
statue,
yeah,
no
nasty
mess
and
the
allocation
of
web
back
bus
I
mean
my
thighs.