►
Description
Don’t miss out! Join us at our upcoming hybrid event: KubeCon + CloudNativeCon North America 2022 from October 24-28 in Detroit (and online!). Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.
Deep Dive into Minikube - Medya Ghazizadeh & Sharif Elgamal, Google
A deep dive into minikube's architecture and sharing top 20 useful tips on using minikube and sharing lessons from 5 years of maintaining minikube.
A
A
morning
or
good
noon
or
what
it's
11
55,
so
I
think
good
morning
is
appropriate
it's
good
morning
and
then
later
five
minutes
later,
it'd
be
good
afternoon
kubecon,
it's
so
great
to
be
here
in
in
person
in
valencia,
spain.
So
I'm
so
happy
to
see
you
guys
in
person
again
and
I'm
here
to
talk
about
mini
cube,
so
first
of
all
sheriff
could
not
make
it
so
I'm
here
presenting
for
both
of
us
who
am
I
I'm
a
technical,
lead
manager
at
google.
A
I've
been
a
mini
cube
maintainer
since
2019
and
I've
worked
other
works
in
the
open
source
world,
create
guard
unicorns
that
have
been
a
cube,
gopro
bunch
of
others.
I
have
been
doing
a
lot
of
open
source
works
in
my
past
four
years
of
life
sheriff
is
also
a
software
engineer.
He's
been
part
of
the
google's
container
tools
team
since
2016
and
minicube's
maintainer,
since
2019.
A
Actually
it
was
started
by
google
by
the
same
team
that
creates
container
tools,
for
example,
scaffold
canico
jib
kept
techton,
so
the
same
team
that
created
those
tools
created
minicube
six
years
ago,
and
the
original
proposal
was
just
to
a
tool
that
gets
you
started
with
kubernetes
without
pain,
just
like
for
learning
kubernetes
for
somebody
just
like
I
want
to
get
my
hands
on
kubernetes
some.
Sometimes
it's
hard
to
remember
that
this
has
this
project
has
been
alive
and
it's
been
working
for
you
guys
for
past
six
years.
A
Some
people
remind
us
on
twitter
took
a
screenshot,
but
why
google
is
supporting
minicube
google
has
been
the
main
sponsor
of
mini
cube
in
terms
of
headcounts
getting
full-time
software
engineering
injuries
working
on
them.
Google
contributes
to
a
lot
of
open
source
projects,
and
I
mean
kelsey.
I
love
kelsey,
so
give
it
up
for
kelsey.
I
think
he's
such
an
inspiring
person
he's
such
a
great
person.
A
I
love
kelsey,
but
he
missed
to
manchester
mini
q,
so
kelsey
you're
not
perfect,
so
google
has
been
contributing
to
minikio
as
the
main
sponsor,
but
we
have
maintainers
across
the
world
one
of
time
there
was
a
tiny
dream.
We
dreamt
that
we
have
maintainers
from
four
continents
in
the
planet,
but
we
can't
have
three
continents.
Unfortunately,
we
don't
have
africa,
but
we
like
to
have
maintenance
from
all
over
the
world,
but
why
google
google
cares
about
development
experience
across
across
the
ecosystem,
especially
for
kubernetes.
A
The
primary
goals
of
mini
cube
has
been
laid
off
and
then
we're
very
clear
on
website.
We
are
inclusive
community
driven
user
friendly
support
for
all
kubernetes
features,
class
platform,
reliable
high
performance
and
developer
focus.
These
are
our
like
goals
and
principles.
A
Here
is
a
fun
chart.
I
generated
this
is
the
mini
cube
code
lines
of
code
since
we
started
in
2016,
we
are
about
1.5
million
lines
of
code.
It
looks
a
little
bit
scary,
but
you
know
don't
be
scared.
You
can't
contribute
who
are
behind
many
cube's
emojis
by
show
of
hands
who
has
used
mini
cube
here.
A
Oh
my
god,
everybody
almost
you
guys,
know
me
with
the
emojis
right.
I
talk
to
you
guys
like.
Oh,
I
like
the
emojis
like
who
are
the
people
behind
emojis
729
contributors
have
contributed
to
mini
cube,
but
we
actually
built
a
tool
in
in
mini
cube.
We
call
it
pull
sheet
and
we
open
source
that
tool
as
well
that
tool
visualizes
the
contributions
that
all
our
contributors
do,
including
the
contributors
who
do
triage
contributing
like
if
you
label
issues
for
us.
A
If
you
organize
our
issues,
if
you
help
other
users,
we
recognize
that
actually
go
to
our
minitube
website.
You'll
see
the
yearly
dashboards
all
of
the
contributors
to
minicube
exactly
what
they
did.
We
have
some
fun
categories,
like
the
most
helpful
pr
reviewer,
the
most
wordy
pr
viewer
so
like
we
have
fun
categories
check
it
out
now
the
tool
that
we
open
source
is
called
pull
sheet,
I'll
I'll
have
a
slide
about
the
links
of
all
of
those
in
a
in
the
future.
A
One
thing
I
want
to
talk
about
mini
cube
that
I,
like
you
guys
know,
is
testing
mini
cube,
is
different,
very
different,
and
I
I
think
no
other
project
in
our
namespace
has
done
testing
like
minicube,
and
what
is
that
minicube,
as
you
guys
might
be
aware,
uses
many
virtualization
technologies
to
start
a
kubernetes
for
you.
It
could
be
a
vm
driver
or
a
container
driver
or
no
driver
at
all,
but
testing
that
you
cannot
test
that
on
a
container.
You
cannot
test
it
on
a
normal
linux.
A
You
need
a
hardware
that
supports
nested
virtualization,
and
this
was
actually
our
first
integration
test
machine
that
we
built
in
san
francisco
office
in
google,
you
but
basically
bought
a
bunch
of
windows,
mac
and
and
and
by
linux's,
with
gpus
and
hooked.
It
together
made
the
jenkins
out
of
it.
A
Unfortunately,
this
test
lab
died
because
of
corona
because
we
could
not
go
to
the
office
to
you
know
unplug
it
or
restart
it
so,
but
this
was
our
first
integration
test
so
because
minicube
testing
is
hard
and
different
because
we
need
nested
virtualization
and
you
cannot
have
that
on
macos
or
windows
in
the
cloud.
A
Minicube
has
a
huge
amount
of
supports
for
different
types
of
virtualization
technology,
so
we
have,
of
course,
all
operating
systems,
two
main
cpu,
architectures,
x86
and
arm
by
the
way,
while
I'm
here
please
use
x86
if,
instead
of
amd64,
please
it
I
hit
with
my
eyes
when
I
have
to
figure
out,
is
it
arm64
or
mdc64?
It's
so
hard
just
say
x86,
please,
let's
all
agree
on
this
x86.
Yes,
thank
you
for
a
mini,
clap,
mini
clap
in
a
mini
cube.
Talk.
Thank
you.
A
So
many
cube
has
support
for
many
architectures
and
many
times.
What
is
around
time,
but
does
anybody
feel
like
they
don't
know?
What
is
the
container
runtime
in
a
kubernetes?
Raise
your
hand?
If
you
don't
know
what
is
a
container
on
time?
Okay
seems
like
everybody
knows
so.
Minicube
has
support
for
three
different
run
times
for
your
engine,
not
for
a
driver
and
also
you
have
different
for
for
the
cni's.
So
we
we
test
all
of
that
all
the
green
ones.
We
actually
test
them
the
grey
ones.
We
don't
have
integration.
A
A
We
break
things
all
the
time
and
you
know
I
break
things
all
the
time
and
I
I
want
to
save
myself
from
myself
by
adding
tons
of
integration.
Tests
like
a
user
wants
to
start
minicube
deploys
an
app
and
then
they
want
to
enable
a
cni
and
then
they
want
to
stop
minicube
and
then
when
they
want
to
start
it
again
and
they
want
to
expect
all
of
that
to
be
there.
So,
let's
add
integration
tests
for
that,
and
also
for
296
other
scenarios.
A
We
have
a
list
of
all
of
that
in
our
website.
All
of
the
scenarios
that
mini
cubes
test
that
makes
my
life
easier.
So
if
I
accept
the
pr
I
know
it's
gonna
not
break
things,
but
but
but
this
is
something
I
want
to
talk
about
when
you
have
so
many
integration
tests
in
so
many
vms.
In
so
many
clouds,
you
review
pr.
You
see
five
failures
out
of
300.
A
We
are
all
now,
if
you're
self
engineers,
we
all
have
flake
flakes
test.
Who
here
has
flake
rates
in
their
company
like
a
test
that
fakes
sometimes?
But
it's
not
a
real
failure.
Okay,
that's!
Okay!
Okay:
okay,
I
was
a
little
bit
terrified
that
nobody's
gonna
raise
their
hands
like
oh
flake
rate
is
your
problem.
We
all
have.
B
A
Okay,
I
think
I
I
saw
about
12
hands
for
the
people
who
did
not
see
the
hands
now,
so
we
have
tests
that
you
know
ten
percent
of
the
time
they
fail,
but
there
are
innocent
failures
that
the
the
really
not
the
test
failure,
but
when
you
have
five
six
of
them
on
a
pr
you
don't
know
which
one
is
actual
failure
and
which
one
is
a
real
failure
of
that
pr,
and
we
have
been
burned
by
that
in
the
past.
So
we
built
a
system
called
flare
crate
system
to
tell
you
this.
A
It
comments
on
the
pr.
It
tells
you
with
a
visualization
with
a
graphic.
This
test
that
filled
on
this
pr
has
never
filled
and
mastered
before,
and
most
probably
is
because
of
this
vr,
and
we
built
this
flickr
system
for
mini
cube,
based
on
go
poke
and
I'm
going
to
talk
about
gopog,
because
this
is.
I
was
adding
this
picture
right
like
20
seconds
ago,
and
I
was
googling
this,
so
you
could
see
that
I
actually
didn't
do
a
good
job
cropping
the
the
google
search
anyway.
But
what
is
go
pog?
A
So
we
have
a
lot
of
integration
tests
and
if
you
have
seen
golang's
integration
test
results,
they
are
they're.
Raw
and
minicube's
test
logs
are
very
verbose,
and
it's
good
that
it's
verbose,
because
if
something
is
failed,
we
know
exactly
what
is
going
on.
So
a
field
mini
cube
test
log
could
be
about
10
to
20
000
lines
of
logs,
and
that
is
really
hard
to
look
at
if
you're
looking
for
a
specific
test,
so
I
built
a
tool
called
gopog
that
converts
the
the
goal
line.
A
Integration
test
results
from
raw
to
to
html,
I'm
going
to
show
you
guys
an
example
of
it.
So
this
would
be
like
an
example
of
test
result.
It's
very
hard.
It's
like,
let's
say
290
tests,
it's
very
hard
to
look.
What
is
what
right!
So,
if
you
convert
that
to
html,
it
will
be
like
this
it'll
give
you
a
summary.
You
can
fold
them
and
fold
them.
These
are
the
failures,
and
this
is
the
duration.
You
can
sort
them
and
you
can
jump
to
every
single
one
and
open
each
one
in
a
different
window.
A
So
this
helped
us
to
squint
less
when
we
review
pr's
for
our
mini
cube
so
and
by
the
way
we
built
the
flake
rate
system
on
the
top
of
gopro.
So
if.
C
A
A
golang
guys
or
girls
or
gals,
and
you
could
use
gopro
to
you-
know,
have
a
more
human
looking
human,
like
that's
a
terrible.
What
would
I
say,
more
user-friendly,
more
user-friendly
way
of
looking
at
test
locks.
This
is
a
diagram
of
our
infrastructure
situation.
We
hooked
up
so
many
clouds
to
one
master
jenkins.
A
A
Actually,
you
can
check
out
that
framework
in
minicube
repo
as
well,
if
you
want
to
add
translation
to
your
own
golang
app.
So
currently
we
have
english,
german,
spanish,
chinese,
french,
japanese
and
korean
and
polish
so
and
it's
very
easy
to
add
your
own
language,
if
you're
in
europe,
if
you're,
like
you're,
very
enthusiastic
about
that
language-
and
you
want
to
add
it
to
mini
cube,
just
go
to
minitube
website
search
for
translation,
there's
a
json
file,
basically
that
you
just
fill
it
out
and
a
json
file.
A
A
Here's
a
slide
that
I
promised
you
guys
that
will
show.
These
are
the
side
projects
of
mini
cube.
If
you
want
to
take
a
look
at
it
or
screenshot
it
something,
this
is
all
of
them,
so
I'll
go
over
them
very
quickly.
Very
quickly.
Slow
jam
is
a
tool
that
we
built
to
visualize
the
stacked
traces
of
a
golang
app.
A
So
if
you
have
a
golang
gap
and
you
want
to
visualize
what
is
doing
what
and
what
is
taking,
how
much
and
visualize
that
use
slow
jam
triage
party
is
another
tool
that
graduated
out
of
mini
cube.
I
call
the
mini
cube
side
project.
We
first
built
them
for
mini
cube,
and
then
we
just
gave
it
out
to
the
world
and
say
everybody
could
use
that.
So
trash
party
helps
you
to
trash
issues
in
a
crowdsourced
manner.
Minicube
has
12
000
issues
on
github.
A
Can
you
believe
that
and
you're
not
just
so
many
of
us
will
maintain
minicube.
It
would
be
very
hard
if
you
wanted
to
charge
all
of
it
all
ourselves.
So
we
built
this
tool
that
you
could
crowdsource
the
charging
issues
and
then
we
actually
we
have
this
weekly
meeting
called
trash
party,
wednesdays
a.m,
pacific,
california,
time
you
could
welcome
to
join
our
party
on
wednesdays
and
goldberg.
I
already
talked
about
that
time
to
kate's.
A
This
is
another
tool
that
I
really
like
and
we
built
it
for
mini
cube,
but
it's
available
for
everybody
when
we
were
trying
to
make
mini,
cube
fast
and
makeup
used
to
be
very
slow
by
the
way.
You
probably
guys
already
know
if
you
are
a
long
time
mini
cube
user
like
three
four
years
ago
make
you
wish
to
take
three
four
minutes
to
start
so
we
we
invested
a
lot.
A
Minitube
is
not
slow
anymore,
but
we
built
a
tool
called
time
to
case
that
measures
exactly
how
fast
a
kubernetes
cluster
is
ready
to
be
used.
They'll
tell
you
in
a
visualized
format
that
this
kubernetes
cluster
is
ready
in
30
seconds
or
60
seconds,
and
the
dns
answering
is
ready
in
75
seconds
api
server
and
stds.
So
it
will
tell
you
in
measurements
of
that
matters
for
case.
So
that
way
you
could
compare
minicube
against
other
similar
tools.
A
If
you
want
to
compare
make
you
against,
let's
say:
k3b,
rancher
and
microcase
or
whatever
it's
a
great
tool,
many
give
ci
examples.
A
lot
of
people
ask
me:
can
I
use
makeup
in
pro
and
then
in
github
action
in
whatever
cloud
build,
you
can
see.
Detailed
examples
of
that
and
pull
sheet
is
the
one
that
we
use
to
generate
graphs
for
the
contributors
it's
like
who
contributed
what
and
what
amount,
even
the
triage
contributions.
A
This
is
a
slide.
I
want
to
talk
about.
Kubernetes,
124.,
kubernetes
124
is
a
big
one.
It's
a
really
big
one
for
mini
cube
because
kubernetes,
as
you
guys
all
know,
I
hope
you
all
know.
Maybe
you
don't
know,
did
it
remove
the
support
for
docker
shim.
It
means
kubernetes
no
longer
is
maintaining
that
code
and
this
code
has
been
donated
to
mirantis
and
the
mirantis
can
continue
that
code
for
us,
but
that
means
kubernetes
by
default
will
not
work
with
docker
runtime
anymore.
A
If
I
go
back
to
the
earliest
slide
here
we
had
three
run
times:
docker
container
d
and
cryo.
That
means
docker
would
not
work
anymore,
but
that
is
a
really
bad
thing
really
bad
thing.
Why?
Why
is
a
bad
thing?
A
It's
a
bad
thing,
because
the
docker
on
time
for
local
developers
matters
a
lot,
because
when
you
build
the
docker
image,
what
do
you
build
it
with?
Docker
builds
right,
and
if
you
want
to
move
that
image
to
your
cluster
in
mini
cube,
how
that
will
take
a
long
time
to
just
copy
that
image.
If
you,
if
you
build
it
with
docker,
and
you
want
to
import
it
into
container
d,
it
will
take
some
time
and
we
actually
generated
the
chart
that
it's
36
times
slower.
A
If
you
do
it
for
continuity,
so
mini
gibbs
decided
that
we
really
care
our
main
goals
was
for
the
developers.
We
we
like
the
developers
to
be
happy,
so
we
continue
to
support
the
docker
on
time
for
kubernetes
124.,
even
though
the
miranda
we
are
doing
it
through
the
mirantis,
the
third
party
open
source
tool.
A
Another
story
with
kubernetes
124
that
we're
struggling
with
is
the
c
group
v2
cigarette
v2
is
causing
some
headaches.
Anybody
else
being
caused
that
headache.
Okay,
one
for
one
person,
come
talk
to
me
after
this
okay,
so
we
are
working
on
it.
The
beta
release
of
mini
cube
supports
kubernetes
124
with
the
with
the.
A
Why
were
you
working
on
it?
So
we
decided
to
continue
continue,
not
leaving
our
users
who
really
care
about
building
images
fast.
You
guys
know
mini
cube,
docker
and
command.
Just
that's
one
of
the
most
popular
ways
to
build
images,
and
it's
very
fast
makeup
has
eight
ways
of
building
images.
If
you
are
a
developer,
make
your
docker
amp
is
the
fastest
one
and
we'll
continue
doing
that
for
you
guys
and,
and
it
will
be
36
times
faster,
and
I
want
to
talk
about
global
warming
completely
different
topic.
A
What
do
I
want
to
talk
about
global
warming?
A
mini
cube
used
to
burn
people's
legs
like
we
actually
used
to
joke
about
that
like
this?
Is
the
mini
cube's
middling
meetings?
A
2016
it
used
to
like
really
be
bad.
Like
you
like
turn
on
mini
cube,
your
laptop
will
be
just
like
start.
You
know
the
fan.
Noise
will
be
up,
there'll
be
so
many
issues
like
people
will
complain
about
that.
We
fixed
all
of
that,
but
I
want
to
talk
about
how
we
did
that
we
we
generated
the
flame
drives
for
every
every
function
in
the
structures
we
exactly
figured
out,
which
one
is
taking
much
cpu
anyway.
I
don't
want
to
talk
about
that
topic.
A
There's
another
talk
in
the
two
coupe
cons
before
I'll
link
to
that
we
fixed
the
issues
with
the
cpu
50
percent,
less
cpu
usage
saving
energy,
but
we
have
two
new
things
that
not
many
people
use
that
and
you
could
use
that
if
you
want
to
save
energy.
So
there's
a
command
called
minicube
pause
that
pauses
the
api
server
or
kubernetes,
but
it
does
not
pause
your
applications.
A
What
does
that
mean?
Let's
say
you
apply
an
app
to
your
kubernetes
cluster.
You
say:
cube
ctl
apply
my
app
and
that
will
deploy
an
app
to
your
kubernetes
cluster.
But
now,
if
you
say,
mini
q
pause
what
will
happen,
it
will
pause
the
api
server
kubernetes
api
server,
it
basically
pauses
kubernetes,
but
your
app
is
still
running
inside
kubernetes.
A
So
that
means
you
can
pause
minicube.
Whenever
you
want,
you
could
unpause
minicube
whenever
you
want
to
apply
a
new
yaml
and
pause
it
right
after
because
you
don't
need
kubernetes
after
that,
so
we
also
developed
an
add-on
for
mini
cube,
called
auto
pass
that
will
automatically
pause
minicube
for
you
when
you
are
not
using
it
for
five
minutes,
so
you
could
actually
enable
that
add-on
called
mini
cube
add-ons
enable
auto-pass.
A
So
if
you
want
to
be
a
good
citizen
and
save
energy
for
our
planets
use
that
I
care
about
this,
because
I
heard
in
the
kubecon
there
was
a
talk
that
it's
projected.
Eight
percent
of
the
global's
electricity
is
going
to
be
used
on
data
centers
and
software.
So
I
mean
we
could
do
something
a
little
bit,
not
much
in
the
software
world
to
save
energy.
A
A
There's
a
section
for
image
builds
so
and
there's
a
section
for
time
to
case,
and
then
we
we
do
them
weekly,
daily
and
per
release.
We
also
benchmark
mini
cube
against
similar
tools,
like
kind
k3d
microcase.
We
want
to
know
how
minicube
is
doing
against
the
similar
tools
all
the
time.
So,
if
you're,
if
you
like
benchmarking
like
me,
if
you
want
to
see
more
of
that
go
to
munich
websites,
benchmarking
section,
we
got
tons
of
things
for
you
to
look
at
now.
Let's
talk
about
a
whole
new
topic,
mini
cube,
face
image.
A
Not
that
many
so
who
uses
a
docker
driver?
Okay,
more
people
use
docker
driver
okay,
so
we
have
two
base
image
in
mini
cube.
One
of
them
is
for
the
docker.
It's
a
docker
file,
basically
based
on
ubuntu,
and
one
of
them
is
an
iso
that
we
built
for
the
vm
drivers,
and
this
iso
is
six
years
old
and
we
basically
built
our
own
linux.
We
are
maintaining
a
linux
distro
for
a
mini
cube.
It's
just
enough
linux.
For
kubernetes.
A
We
are
planning
to
graduate
this
project
out
of
mini
cube,
just
like
many
other
projects
that
were
graduated
out
of
minicube,
so
it
will
be
an
iso
for
the
whole
world.
That
is
just
enough
kernel
modules
for
kubernetes
we
hand
crafted
this
iso,
it's
very
small
compared
to
the
com
summary
isos,
that
I've
seen
there's
like
some
of
the
isos
like
800
megabytes,
some
of
them
a
couple
of
gigabytes,
and
we
first
started
based
on
a
core
os
belt
route,
but
we
diverged
so
much
that
we
can
no
longer.
A
A
A
But
what
I
want
to
talk
about
is
there's
a
new
category
of
you
guys
out
there
and
you
guys
are
sending
surveys
you're,
sending
blog
posts
twitters.
We
hear
you,
you
hear
you.
I
think
it
was
last
year
that
docker
desktop
announced
that
they
gonna
charge
companies
for
more
than
more
than
200
employees
and
10
million
dollar
revenue.
A
I
believe,
if
they
use
docker
desktop,
says:
docker
is
a
commercial
product
paid
commercial
product
and
initially
a
few
users
posted
a
blog
post
that
I
am
using
mini
cube
as
a
docker
desktop
replacement,
and
it's
like,
oh
my
god.
This
is
a
new
type
of
users
and
turns
out
the
demand
is
really
high.
Like
we,
we,
I
took
a
quick
analysis
on
the
survey,
there's
a
huge
amount
of
interest
for
this,
and
you
could
see
some
of
this
screenshots
on
that.
A
So
a
lot
of
people
are
very
happy
with
replacing
docker
desktop
with
mini
cube.
For
that
reason,
the
added
feature
is
very,
very
ironic,
very
ironic
that
you
could
start
mini
cube
without
kubernetes.
A
A
A
A
There
are
many,
many
nitty
gritty
small
differences
between
all
of
them,
but
if
you
ask
me,
what
are
the
main
differences
between
them?
I
would
say
the
main
difference
is
mini.
Cube,
supports
multiple
container
runtimes.
All
other
tools.
I
mentioned
the
oil
container
d
run
time.
Mini
cube,
has
docker
container
d
anchor
io
mini
cube,
is
more
diverse
in
that
sense,
and
the
darker
part
of
it
is
very
important
for
for
fast
image
build
by
the
way.
A
Let
me
pivot
back
to
the
previous
one
that
people
using
mini
cube
as
a
docker
desktop
replacement.
That
means,
as
you
guys
know,
docker
is
two
parts.
One
of
them
is
open
source
mobi
project
which
is
open
source
engine,
and
one
of
these
docker
desktop
docker
desktop
is
a
commercial
product,
but
the
docker
container
runtime
itself
is
a
free
product.
So
when
you
use
mini
cube
as
a
docker
desktop
replacement,
you
could
basically
install
a
docker,
cli
and
still
docker
image,
build
in
open
source
freeway
and
build
it
against
mini
cubes
docker.
A
That's
how
people
are
using
it,
so
it
could
get
confusing.
So
the
main
difference
of
mini
cube,
I
would
say,
is
the
container
runtimes.
We
support
all
of
them
and
also
the
second
difference
is
a
fast
image
build
36
times
faster
image
builds
according
to
our
benchmarks
than
other
tools.
So,
if
you're
an
app
developer,
who
wants
to
develop
apps
on
kubernetes
on
your
laptop,
I
think
the
mini
cube
is
the
only
answer
for
you,
and
also
our
integration
test
is
comprehensive.
A
I
in
our
namespace,
I
don't
know
any
other
project
who
is
doing
this
level
of
massive
amount
of
integration
tests
on
physical
machines,
advantages
of
vm
drivers.
There
was
a
time
I
think
20
early
2020
or
maybe
late
2019.
A
A
lot
of
people
asked
me:
is
there
even
a
need
for
mini
cube
to
continue
the
vm
drivers?
I'm
a
kind
of
a
stubborn
guy,
and
I
said
yeah
I
want
to
continue
supporting
vm
drivers.
I
never
thought
one
day.
I
will
see
this
level
of
interest
in
vm
drivers
again,
but
I
just
I
myself-
love
the
vm
drivers
more
than
a
docker
driver.
I
don't
know
why
I
just
loved
it.
I
I
continued
with
my
stubbornness.
A
I
continued
doing
it,
but
now
there's
a
huge
amount
of
interest
in
it,
and
a
lot
of
people
are
using
vm
drivers
again
because
docker
desktop
is
a
vm
driver
too
they're
you're
not
gonna,
have
a
container
on
mac
or
windows.
Ever
you
need
a
linux.
You
need
somebody
to
visualize
that
for
you
and
I
like
the
mini
cube's
iso,
it's
very
small.
That's
one
of
the
reasons
for
my
stubbornness
on
it.
A
Vm
drivers
clearly
really
use
significantly
less
cpu
than
the
docker
driver,
and
one
of
my
favorite
things
with
the
vm
driver
is
you
can
hit
the
ip
directly.
So
if
you
have
a
service
on
a
host
port
on
kubernetes
deployed,
let's
say
it's
on
port
80:
you
can
hit
the
minicube's
ip
on
port
80
directly
and
container
drivers
like
docker
or
pipeline.
A
A
A
If
you
could
tell
us
and
they
they
told
us,
we
want
vm
drivers
on
m1
m1,
as
you
guys
probably
know,
is
apple's
new
hardware.
It's
arm.
64
based
and
people
want
a
driver
that
would
work
on
it
with
a
vm
driver.
You
could
use
the
docker
driver,
but
so
I
have
exciting
news
for
you.
We
have
pmu
driver
working
and
I
tried
it
yesterday
myself
and
huge
amount
of
work
went
to
this.
It
took
us
a
long
time
and
you
guys
were
patient
with
us.
Thank
you
for
being
your
patients.
A
A
Personal
likeness
for
kmu,
I
think
it's
a
great
open
source
project
and
my
dream
is
to
make
kmu
the
the
unified
driver
everywhere
on
any
platform.
So
you
would
have
cmu
on
windows,
linux,
mac
and
they'll
be
all
same
vm
driver,
but
I
need
some
help
guys.
I,
if
you
guys,
are
experts
on
on
virtualization
and
iso,
come
talk
to
me
and
I
actually
might
be
hiring
as
well,
so
you
could
actually
try
the
kmu
driver
today.
A
Just
basically
brew,
install
kmu
on
your
mac
and
then
you
know
install
the
beta
version
of
mini
cube,
not
the
stable
one
and
then
minicube
starts
dash
dash
driver
kmu2.
And
if
you
want
to
download
the
beta
of
mini,
cube,
easy
go
mini,
cube
website
and
then
click
on
your
your
platform.
For
example,
mac
os
arm64
beta,
make
sure
you
choose
the
beta.
That
way
you
could
try
the
kmu
driver.
A
It
was
very
hard
to
be
honest
to
deliver.
This
we've
been
working
on
it
a
few
months,
so
we
basically
had
to
rebuild
our
just
enough
linux
for
kubernetes
for
arm
64..
Every
package
had
to
be
done
again.
Every
kernel
module
had
to
be
done,
and
then
we
had
issues
with
app
armor
upper
armor
does
not
like
the
the
efi
bias,
because
if
you
want
to
have
a
rmc
164
machine,
you
cannot
have
a
bios
anymore.
You
can
need
to
have
an
efi
boots
loader.
A
This
puts
tremendous
amount
of
energy
to
make
the
efi
work,
but
then
app
armor
was
not
happy.
It's
like
I
don't
like
efi,
and
it
was
a
lot
of
work
kudos
to
sheriff
el
gamal
he's
not
here.
Today
I
mean
he's
in
california.
I
couldn't
make
it
he
and
really
did
amazing
work
on
this
and
also
anders
bjerkland
or
other
maintainer.
He
guided
us
through
this
and
I'm
very
grateful
for
having
such
amazing
team
an
amazing
maintainers
in
manicure,
so
try
try
them
with
the
kma
driver.
A
Another
exciting
news.
We
have
a
gui
four
mini
cube.
Finally,
this
was
something
people
have
been
asking
us
and
I
was
like
always
like
on
the
what's
that,
what's
the
word
fence
to
say,
gooey
come
on
guys
mini
cube
does
not
need
a
gui,
but
now
we
have
a
gui
and
you
convinced
us,
okay,
it's
built
in
q3.
I
can
show
you
like
a
little
bit
of
it.
I
don't
know
if
I
am
actually
this
is
so.
This
is
a
mini,
cable,
tray,
icon
like
this,
you
can
see
starting
a
kubernetes.
A
I
can
see
there's
a
cmu
running
and
you
can
create
another
one
like
that.
So
this
is
early
le
development.
If
you
want
to
give
it
a
try,
go
to
mini
cube
website
and
search
for
mini
cube
gui,
we
have
instructions
how
to
install
it.
Cool
new
contributors
are
always
welcome.
You
know,
check
out
our
office
hours
mondays,
california,
time
11
a.m.
A
Look
out
for
good.
First
issues.
We
are
very
friendly,
but
we
also
want
experts
and
I
am
hiring
so
dm
me
on
twitter.
If
you,
if
you
want
to
work
with
law
level,
linux
stuff
or
if
you
have
gui
skills
like
qtc,
plus
plus
or
hypervisor
technologies
and
build
roots,
build
root,
is
the
tool
that
we
use
to
build
our
own
linux.
A
That
was
the
end
of
my
slice,
and
I
just
remembered
I
forgot
to
put
the
mini
cubes
twitter
in
my
slide,
so
mini
gives
twitter
just
mini
cube,
underscore
dev
follow
us.
We
whenever
we
release,
we
share
our
release
on
twitter
and
I'm
available
for
any
questions
you
might
guys
might
have.
So.
Thank
you
very
much.
B
Hi,
thank
you
a
lot
for
your
talk,
I'm
more
interested
into
the
vm
driver
and
I
would
like
to
know
several
things
about
it.
First
of
all,
you
just
say
that
you
will
move
it
to
a
dedicated
repo,
and
so
what
are
your
plans
regarding
the
kernel
version?
Because,
actually,
if
I
remember
correctly,
the
connection
of
the
image
is
for
the
19
and
I
would
like
to
know
if
you
plan
to
bump
it.
A
So
your
question
about,
I
didn't
understand
your
question.
Your
question
was
about
the
versioning
of
the
iso.
No,
I
didn't
understand
it.
A
So
currently
we
have
kernel
4.9,
which
is
a
shame.
I
know
we
have
been
wanting
to
go
on
kernel
point
5.10.
However,
we
waited
until
we
figure
out
the
bootloader
situation.
The
bootloader
was
very
difficult
to
make
it
work
and
we
didn't
want
to
introduce
two
big
new
changes
at
the
same
time.
So
it's
like
now
that
we
have
the
bootloader
under
control
for
sure
we're
gonna
invest
in
kernel
5.10.
A
I
think
that's
that's
the
right
thing
to
do,
especially
with
the
c-group
v2
being
supported
mostly
on
kernel,
five
yeah.
B
Okay
and
then
regarding
the
of
the
route,
I
see
in
your
repository
that
you
have
that
you
have
a
dedicated
directory
for
dot
mk
files,
basically
the
bill
root
recipe,
and
so
do
you
have
some
plan
to
upstream
them,
because
it
will
be
far
easier
for
your
life.
I.
A
Like
your
question,
I
think
you,
your
question,
shows
you
actually
have
been
looked
at
that.
So
that's
a
that's
a
question,
so
we
do
not
plan
to
have
the
the
file
system.
Overlay
is
what
you
were
referring
to
into
the
open
source
file.
That
would
be
something
that
the
way
we're
going
to
build.
That
is
like
anybody
who
wants
to
use
this
iso.
They
will.
They
will
get
the
iso
and
add
their
own
files
on
top
of
it.
B
One,
okay
and
then
the
one
remark,
maybe
because,
but
I'm
not
sure
about
it,
you
say
that
you're
using
a
ufc
bios
about
using
particularly
for
the
arm
port,
the
u-boot
to
basically
boot
the
linux,
because
you
boot
on
linux
on
arm
64.
It
is
just
perfect
and
for
you
ufc
bios,
I'm
not
sure
so.
Do
you
have
some
plan
to
maybe
use
your
boot
and
I'm
almost
sure
that
within
bid
root,
you
can
just
take
one
make
menu
config
and
you
have
a
u-boot.
A
I
don't
think
we're
gonna
have
that
option.
That
would
be
slightly
above
the
scope
of
us
to
to
have
that
option
configured
if
we
can
make,
if,
like
we
have
a
contributor
that
who
wants
to
take
the
ownership
of
that
we
will.
But
one
of
the
things
that
I
focus
on
as
a
maintainers
of
youtube
is
keeping
it
maintainable
for
myself
and
my
team,
because
you're
a
small
team,
it
does
seem
like
something
would
be
challenging
to
give
that
option.
If
we
promised
that
option,
I
would
want
to
see
the
implementer
of
that
option.