►
Description
Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io
Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects
Minikube: Bringing Kubernetes to the Next Billion Users - Thomas Strömberg, Google
Observations on the major challenges for making Kubernetes useful to people around the world, how minikube is addressing these challenges, and how the Kubernetes community can help make the world a better place. Specific topics include: - Language localization - Documentation localization - Network localization - Operating system support - Making failures actionable and friendly - Making a project more inclusive and inviting to new contributors
https://sched.co/Nrmy
A
I've
been
doing
open-source
software
for
about
20
years
now
and
I've
been
at
Google
for
the
last
13
years
and
amazingly
enough,
Google
pays
me
to
do
open
source
software
development
full
time.
It's
pretty
much
my
dream
job
now.
How
did
I
get
started
like?
Why
did
I
start
writing
software
and
how
did
I
get
started
in
open
source
development?
Well,
I
started
as
a
Systems
Administrator
and
a
really
lazy,
Systems
Administrator,
who
wanted
to
automate
everything
ruthlessly
if
I
have
to
do
something
twice.
A
You
know
kind
of
a
pre-internet
thing
where
you
would
dial
someone's
modem
in
someone
else's
house
and
you
would
chat
with
one
another
share
files
and
I
kind
of
fell
in
love
with
this
idea
of
using
technology
to
connect
people
from
far
away
and
I
knew
by
about
age
13
that
I
want
it
to
be
a
systems
administrator.
I
wanted
to
use
technology
to
connect.
People
I
was
inspired
by
how
useful
these
tools
were
and
how
easy
they
were
to
use
and
I.
Think
all
of
you
probably
came
into
being
software
engineers.
A
Similarly,
you
were
you
used
a
piece
of
software
as
a
kid,
maybe
a
little
older
and
you
were
inspired-
you
were
like
this-
is
so
cool
I
want
to
build
cool
stuff
too.
So
that's
that's
a
bit
about
me,
rewinding
a
little
further,
so
yeah
there's
a
wonderful
picture
of
me
in
fourth
grade
so
I
was
actually
born
in
Sweden.
A
Swedish
was
my.
You
know
my
first
language,
but
I
moved
to
the
America
at
a
young
age
and
learning
English
was
very
painful.
There
were
so
many
misunderstandings:
I
I
had
to
learn
English
when
I
was
five
and
I
learned
from
a
lot
of
bad
1980s
movies,
like
police
academy
and
flatch,
and
really
bad
movies
and
I
had
a
very
bad
vocabulary
as
a
five-year-old
in
school,
and
it
caused
a
lot
of
problems,
and
it
helped
set
me
on
this
path
of
realizing
that
almost
all
conflicts
and
problems
that
people
have
are
simple
misunderstandings.
A
A
lot
of
cultural
misunderstandings,
language
misunderstandings
there
were
full
of
it,
and
so,
when
I
had
kids
of
my
own,
they
I
highly
encourage
them
to
go
to
a
immersion,
a
language
immersion
school
so
that
I
can
inflict
that
same
pain
of
complete
misunderstanding
and
that
that
growth
model
of
always
feeling
like
you,
have
no
idea
what's
going
on
in
the
world.
But
you
have
to
struggle
through
it.
Anyways
now,
I
asked
my
oldest,
you
know:
there's
I
live
in
San
Francisco,
there's
a
lot
of
different
languages.
You
can
choose
from.
They
chose
Cantonese.
A
Why
did
she
choose
Cantonese
because
she
likes
dumplings?
So
so
that's
two
and
teen
sing
and
I
am
tune
Tomasi,
but
anyways.
So
so
in
thinking
about
this
talk,
I
was
really
thinking
a
lot
about
the
role
of
a
programmer
and
how
many
of
you
here
I've
read
the
mythical
man-month.
It's
one
of
my
favorite
books
about
programming.
Yes,
it's
old
I
mean
a
lot
of
it
takes
place
about
like
describing
what
happened
in
the
1960s
and
70s.
A
And
what
you
realize,
when
you
read
this
book,
is
that
we
haven't
solved
very
many
of
the
problems
that
he
talked
about,
and
one
of
my
favorite
quotes
from
it
is
that
the
programmers
role
is
to
deliver
satisfaction
of
a
user
need
rather
than
any
tangible
product
and
when
I've
managed
other
software
engineers
who
complain
about
oh
I
hate
when
they
changed
the
requirements
and
why
do
I
have
to
talk
to
users?
And
you
know
why
do
I
have
to
deal
with
people?
A
As
a
software
engineer,
your
role
is
delivering
satisfaction,
it's
not
the
code,
it's
it's
the
satisfaction,
it's
meeting
a
need,
and
so
I.
My
own
interpretation
of
this
is
that
successful
software
adapts
to
the
needs
of
users
and
successful
adaptation.
Empathy
now
empathy
in
terms
of
my
talk
is
understanding.
The
needs
of
the
rest
of
the
world.
I
live
in
San
Francisco
I
have
great
internet
access,
I
speak
English.
Kubernetes
is
pretty
easy
for
me
compared
to
most
of
the
world,
I
feel.
A
So
some
tools
to
gather
empathy
that
I
that
I
recommend
is
surveys.
You
know
actually
asking
your
users.
What
do
you
want,
and
you
know
some
sort
of
like
freeform
way,
performing
user
journeys
where
you,
where
you
actually
sit
there
and
watching
user,
try
to
use
your
tool,
a
user
who's,
never
used
your
tool,
who's.
Who
is
not
aware
of
it
and
say
use
this,
and
then
you
write
down
every
step
that
they
took
and
every
bug
that
they
surfaced,
because
they
will
surface
a
lot.
Even
if
your
software
is
really
good.
A
What,
if
like
me,
you
are
too
embarrassed
to
speak,
you
lose
you,
the
people
who
are
too
embarrassed
to
speak.
Do
not
answer.
Surveys
do
not
participate
in
user
journeys;
they
don't
open
github
issues,
and
we
see
this
a
lot
for
people
whose
native
language
is
not
the
native
language
of
that
project.
A
A
That's
a
huge
untapped
market
for
not
only
users
of
your
project,
but
members
of
kubernetes
future
software
engineers
there's
a
whole
nearly
half
of
the
world
out
there.
That
doesn't
yet
know
what
this
is
all
about.
Why
we're
meeting
here
today,
the
next
billion
users,
it's
unlikely
they're,
going
to
speak
English
I
mean
it's
roughly
20
I
mean
depends
on
like
how
much
English
they
speak,
but
most
statistics
put
it
around
20%
that
speak
English.
So
that's
80%
that
do
not
have
a
working
English
vocabulary.
A
The
next
billion
users
probably
does
they
don't
have
Gigabit
Ethernet
it'd
be
nice.
This
the
average
speed,
though,
is
surprisingly
good.
I
was
expecting,
like
maybe
megabit,
2
megabit,
the
actual
global
average
right
now,
at
least
according
to
STATS
I
found,
was
closer
to
9
megabit,
which
is
not
too
bad.
A
But
when
I
look
at
it
in
terms
of
how
long
is
it
going
to
take
to
install
like
to
actually
download
all
the
images
for
mini
cube,
your
average
user
in
Egypt
is
going
to
wait
about
an
hour
to
download
the
images
and,
if
you're,
like
you're,
wanting
to
teach
mini,
qu
they're
like
I,
want
to
learn.
Craigan
IDs,
I'm,
gonna
install
mini
cube,
and
then
it's
like.
Ok
now
wait
an
hour
and
I'd.
Are
they
going
to
be
interested
after.
B
A
A
The
next
billion
users
are
not
Linux
experts
well,
at
least
not
yet.
If
you
look
at
operating
system
statistics
you'll
see
it
like
China,
for
instance,
is
a
great
case
where
the
desktop
share
for
Windows
is
depending
on
the
stats
about
ninety
percent,
which
is
actually
much
more
than
the
United
States.
A
So
a
substantial
portion
of
the
this
next
generation
will
be
inspired
to
become
programmers
like
us,
and
we
really
have
to
be
good
stewards
and
help
them
help
them
with
that
effort.
It's
a
it's
a
great
equalizer.
So
how
do
we
adapt
kubernetes
to
make
it
applicable
to
these
next
billion
users?
Well,
empathy
and
accessibility,
and
so
empathy
by
reaching
out
and
trying
to
get
their
inputs
and
accessibility
by
actually
like
taking
those
inputs
and
making
kubernetes
work
for
them?
A
A
If
we
fail
to
make
kubernetes
accessible
globally,
we'll
end
up
with
splintered
solutions
for
managing
compute
resources,
can
you
imagine
if
kubernetes
actually
came
out
and
is
it
was
the
same
product?
It
is
today,
but
was
only
available
in
Icelandic.
It
probably
wouldn't
be
that
popular,
but
we
could
easily
see
a
world
that
if
we
didn't
try
to
make
things
globally
applicable,
that
Iceland
could
have
its
own
kubernetes
that
almost
nobody
uses,
because
it's
a
tiny
country
and
that
China
could
have
its
own
kubernetes
in
the
US
could
have
its
own.
A
I
saw
this
in
the
1990s,
with
with
UNIX
back,
then
every
different
hardware
manufacturer
had
their
own
UNIX
flavor
gir
X
IBM
had
AIX,
there's
hp-ux
deckle
tricks
next
step.
If
you
wanted
to
change,
if
you
wanted
a
feature
that
was
available
on
a
UNIX
system
that
your
machine
couldn't
run,
you
would
have
to
buy
a
new
machine
and
then
Linux
and
the
BS
DS
they
all
came
around
and
it
completely
changed
the
environment
and
there
are,
with
the
exception
of
Mac,
OS
they're,
all
effectively
dead.
Thankfully.
A
So
what
I
would
like
to
ask
you
to
to
consider
is
to
be
part
of
the
virtual,
this
virtuous
cycle.
If
you
want
to
make
the
most
of
your
investment
in
kubernetes,
you
have
to
share
with
the
community
and
because
you
have
a
really
special,
unique
viewpoint
and
circumstances,
and
even
if
it
feels
uncomfortable
to
share
it's
going
to
make
kubernetes
a
better
project
so
back
to
mini
cube
for
a
moment
how
many
people
in
this
room
have
not
used
mini
cube.
All
right,
then,
are
probably
okay.
A
There's
a
handful,
so
mini
cube
is,
is
like
I
liken
it
to
a
a
computer
game
like
Kerbal
space
program,
where
you
want
to
do
a
simulation
of
a
production
environment,
and
you
want
to
do
it
locally.
It's
a
sig
cluster
lifecycle
project,
you,
basically,
you
can
just
do
mini
cubes
start
and
you
get
a
working
kubernetes
cluster
locally
or
you
can
go
into
the
options
screen
and
tune
all
sorts
of
things
and.
A
So
it's
great
for
developers
in
that
case,
but
when
we've
done
surveys,
we've
seen
that
about
30
percent
of
mini
Cube
users
are
installing
it
just
to
learn:
kubernetes
they're,
not
developers.
Yet
they
want
to
see
what
it's
all
about
and
I
was
one
of
those
people.
When
I
was
you
know,
when
I
saw
an
opportunity
to
join
a
kubernetes.
Creepos
like
let
me
learn,
kubernetes
mini
cave,
looks
easy
and
then
I
got
really
sad.
A
B
A
The
translations
might
look
a
little
strange.
We
currently
have
a
one
issue
in
that
our
string
interpolation
currently
has
to
be
in
the
same
order
as
English.
So
when
you
say
like
kubernetes
14
on
docker,
when
we
translate
to
another
language,
we
also
have
to
have
the
same
order.
We
have
to
move
to
a
more
flexible
format
where
we're
actually
using
like
named
variables
everywhere,
and
so
that
will
come
very
soon.
A
So,
in
fact,
we
actually
have
this
turned
off
by
default
in
the
current
release
until
we
get
that
issue
solved,
but
you
can
basically
see
here
to
the
features
that
we've
done
recently,
which
is
yeah
we're
starting
mini
cube.
We've
selected
an
image
repository
that
works
in
China.
We
selected
here
image
country
image,
mirror
country
China.
There
are
still
quirks
with
Chinese
access
because
we
still
have
to
download
the
ISO
file
from
Google
and
it
will
switch
to
github
very
very
soon.
These
are
the
kinds
of
experiences
that
I
learned
when
I
come
and
visit.
A
So
what
mini
cube
aims
to
deliver
are
all
the
kubernetes
features
that
actually
fit
on
a
single
machine?
It
actually
turns
out.
This
is
pretty
much
everything
you
can
run
into
memory
restrictions.
If
you
run
out
of
memory,
sto
users
tend
to
run
out
of
memory,
because
sto
may
need
more
memory
than
you
have
on
a
single
node,
but
so
how
this?
How
many
cube
works?
Is
we
have
a
machine
driver
in
this
case
VirtualBox
that
Kinect
that
we
basically
it
basically
starts
the
ignition
sequence?
A
A
So
we
have
a
rind
of
ridiculous
support
matrix
we.
So
the
kubernetes
official
policy
is
that
kubernetes
only
supports
the
last
three
versions.
We
recognize
that
there
are
a
lot
of
legacy
users
out
there,
so
we
test
the
last
six
versions.
Currently,
we
will
always
guarantee
the
last
three
versions,
but
we
will
try
to
do
six.
If,
if
it's
viable,
we
support
many
runtimes
catta,
we
don't
support.
Yet
there
are
plans
for
2019.
A
A
We
would
like
to
do
docker
and
pod
man
as
VM
free
drivers.
Soon
operating
systems
are,
as
expected,
I
hope
that
continuous
testing
will
be
re-enabled
on
Windows
next
week
and
as
far
as
architectures
most
users
are
on
64-bit
x86
64,
though
there
are
people
who
are
using
mini
Cube
on
arm
64
and
even
s
time,
RS
390x
for
IBM
mainframes.
A
Some
of
the
misunderstandings
are
from
a
user
to
a
developer,
but
some
of
the
misunderstandings
are
from
a
developer
to
user,
not
understanding
the
use
cases
of
their
users.
I
find
the
latter
to
be
the
most
frustrating
I
think
because
it
shows
a
lack
of
of
trying
in
a
way.
So
here,
I
have
my
local
kubernetes
up
and
running
and
cue.
Cuddle
is
also
localized
already
so
I
mean
nothing.
I
really
need
to
show
there,
but
so
for
MIDI
cube.
B
A
So
one
of
the
fun
things
is
that
you'll
notice,
at
least
on
Mac,
is
that
DNS
resolution
from
Mac
works
directly
into
your
kubernetes
cluster.
If
the
tunnel
is
running
so
if
you
are,
if
you
are
dealing
with
load
balancer
a
type
apps,
this
is
a
really
handy
way
to
do
local
development.
We
would
love
to
get
this
feature
added
on
other
platforms
and
help
is
certainly
welcome
there.
A
We're
kind
of
attacking
on
all
fronts
there
now,
when
I
first
proposed
to
give
this
talk
in
April
I
was
sure
that
I
was
going
to
solve
all
these
problems
by
the
time
June
rolled
around,
and
this
was
going
to
be
my
big
success
story.
It
turns
out
that
the
world
is
complicated
and
this
is
very
much
a
work
in
progress,
so
language
I
did
show
the
localize
command
lines.
We
are
also
working
on
localized
documentation
and
localized
feedback,
and
what
does
localized
feedback
even
mean?
I
will
show
you,
for
instance,.
A
Reports
from
China,
so
I
actually
didn't
know
how
bad
things
were
and
I
think
part
of
this
is
people
will
always
feel
uncomfortable
sharing
feedback
in
a
language
other
than
their
native
tongue.
So
we're
trying
to
do
this
and
kind
of
bear
the
burden
of
the
translation
with
the
help
of
the
community
and
trying
to
understand
what
these
issues
are.
We
want
everybody
to
feel
comfortable
sharing
their
inputs.
A
We'll
see
so
digging
a
little
deeper
into
how
our
translation
works
one
of
the
interesting,
so
it
turns
out
that
language,
translation
and
go
is
not
as
straightforward
as
with
other
languages.
The
libraries
are
not
as
wonderful,
quite
yet
as
say,
Java
or
C++,
if
you
want
to
say,
for
instance,
extract
all
the
strings
that
need
localization.
A
There
are
some
pretty
hacky
ways.
We
we
chose
to
go
for
an
ast
based
approach
where
we
actually
use
gos
ast
parser
to
parse
all
the
to
parse,
mini
cube
and
grab
all
the
messages
that
we
send
to
the
output
library
it
turns
out.
This
is
both
fun,
fascinating
and
scary.
The
way
that
how
much
work
actually
has
to
go
into
this,
we
really
want
to
make
this
a
general
library
in
the
future.
A
A
Another
part
of
localizing
localization
is
not
just
language.
There's,
as
I
am
finding
out,
especially
in
China.
Networking
environment
is
huge,
so
one
of
the
things
that
we
added
earlier
was
mini,
keep
runs
offline
and
has
since
100
you
can
copy
this
directory.
If
you
want
to
have
mini
cube
running
on
a
different
machine
than
you
already
have
access
to,
we,
we
did
get
the
image
mirror
country
we'd
like
to
make
it
automatic,
though
right
now
we
don't
have
a
way
of
validating
the
contents
of
images.
A
From
other
mirrors,
we
have
ideas
on
how
to
do
this
by
basically,
you
know
getting
pinning
to
hashes,
but
we
definitely
would
need
help
there.
As
I
mentioned
earlier.
We
need
to
move
the
release
iso
to
github.
We've
done
a
lot
of
work
recently
to
improve
proxy
support.
It
turns
out
that
some
of
the
more
popular
user
support
issues
are
people
who
have
their
machines
set
up
to
use
a
proxy,
and
then
it
tries
when
we
try
to
access
the
api
server
it's
going
through
the
proxy.
A
A
That's
going
to
mean
me
switching
my
me
and
others,
switching
our
development
workstations
to
Windows
for
a
while
and
ferreting
out
the
bugs
and,
of
course,
getting
help
we
want
to
make
like
Windows
right
now
in
VirtualBox
is
okay,
but
windows
on
hyper-v
there's
a
lot
of
problems
primarily
with
stopping
the
VMS.
We
would
like
to
make
that
wsl
to
first-class
solutions
for
mini
cube
part
of
the
WS
LT
approach.
Is
we
want
to
make
vm3
better
I?
A
Have
this
goal
of
mini
cubes
start
at
least
after
the
first
start
only
taking
15
seconds?
We
are
far
away
from
that
right
now
and
part
of
doing
that
is
we'd
like
to
do
direct
deployments
to
docker
and
pod
man
very
and
very
similar
to
kinda,
and
in
fact
that's
what
we're
using
the
prototype.
We're
hoping
to
build
this
on
top
of
the
kinder
library
and
we'll
be
working
with
the
kind
folks
on
doing
that.
So
kind
is
very
focused
on
fast
conformance
testing
and
their
laser
focused
on
that
there's.
A
A
lot
of
features
that
mini
cube
has
that
they
don't,
for
instance,
the
switching
of
runtimes
flag
based
configuration
of
API
server
and
cube
lid,
and
things
like
that,
and
so
we
want
to
build
those
types
of
features
on
top
of
it.
But
we
still
are
not
abandoning
the
vm
based
methodologies,
because
there
are
still
really
good
cases
for
VMs.
A
Great
documentation
drives
adoption,
so
we're
taking
documentation
very
seriously.
We
do
have
a
hugo
based
website
that
we
have
just
started
rolling
out.
It
doesn't
have
very
much
at
the
moment
because
I'm
still
learning
on
how
to
do
menus
anymore
in
hugo.
If
there
are
any
Hugo
experts
out
there,
I
would
love
your
help.
See
ya.
There's
definitely
help
wanted
on
the
documentation.
A
I
would
like
to
get
all
the
documentation
translated
into
you
know,
into
the
same
languages
that
the
rest
of
kubernetes
Doc's
have,
and
we
could
definitely
use
tech
writers
to
review
PRS
for
documentation
to
help
us
help.
Let
us
know
where
we're
falling
flat
in
how
we
approach
skill
levels.
Well,
because
mini
cube
is
a
learning
tool
for
a
lot
of
people
in
the
world.
We
want
to
make
sure
that
the
errors
are
very
actionable.
A
It
used
to
be
like
when
I
first
started,
learning
mini
cube.
That
I
would
get
a
panic
or
back-trace
and
or
some
inscrutable
message.
You
know,
I
didn't
necessarily
know
at
the
time
what
the
different
hypervisors
were.
So
now,
we've
made
it
for
many
errors.
We
actually
point
users
to
a
specific
document
to
read
or
github
issue
to
read,
so
we
basically
have
this
file.
A
A
The
more
you
know,
and
in
my
experience
with
automation,
the
less
you
involve
users,
the
less
you
involve
like
human
12,
the
less
your
support
cost
and
while
I
love
talking
to
people,
I
really
hate
going
through
the
same
github
issues
every
day.
So
I
would
like
a
single
step
installer
that
basically
just
fixes
everything
for
you
and
similarly,
no
flags
required.
I
would
like
it.
So
that
when
you
run
mini
cube
on
a
machine,
if
you
have
hyper
kit
installed
and
you
don't
have
VirtualBox
installed,
it
should
just
default
to
using
hyper
kit.
A
A
So
unsolicited
advice
overcome
your
embarrassment.
Badly
translated
inputs
are
better
than
no
inputs.
Even
if
you
have
to
run
your
your
thing
through
a
translator
to
open
a
github
issue,
just
do
it.
We
won.
We
want
to
know,
what's
going
on
project
owners,
have
it
in
their
best
interest
to
have
your
help
projects
the
project
with
the
most
inclusive
community
wins.
We've
seen
this
with
Linux
we've
seen
this
with
kubernetes
onboarding
is
as
important
as
coding
ignore
the
next
billing
at
your
peril,
so
yeah.
A
So
if
you're
interested
in
joining
us
there's
a
couple
of
things
here,
the
survey
is
embarrassing,
really
not
available
in
China.
Without
a
VPN,
you
can
see
that
our
survey
is
not
as
useful
as
it
should
be.
I
will
work
on
fixing
that,
but
yet
non-english
speakers
welcome
feel
free
to
contact
me
on
WeChat
or
Twitter.
So
any
last
questions
or
any
questions,
I
guess.
B
C
A
If
you
run
cube
Adam
on
your
machine,
you
could
open
it
up
to
issues
where
you
might
actually
like
delete
files
or
delete
stuff
and
docker,
whereas
when
you're
running
it
inside
a
VM,
it
is
constrained
to
that
environment
and
it's
important
primarily
for
running
on
Mac,
OS
or
Windows.
So
if,
if
you
run
mini
cube
with
the
none
driver,
it
actually
just
uses
cube
ATM
100
Eve
on
Linux,
if
you
run
it
with
any
of
the
drivers,
but
it's
effectively
keep
I.
Do.