►
From YouTube: OpenZFS Everywhere by Michael Dexter & Jorgen Lundman
Description
From the 2019 OpenZFS Developer Summit
slides: https://drive.google.com/open?id=1COC71QIvjj5fQw0dJEN5IPApEm56hivm
B
B
So
a
very
brief
history
of
the
history
of
open
ZFS
on
other
platforms.
Naturally,
the
the
source
of
truth
was
open.
Solaris,
for
opens
what
became
open
ZFS,
but
real
early
on
Apple
was
involved
with
hey
their
own
work
prior
to
the
acquisition,
and
there
are
still
remnants
of
that
you'll
bump
into,
and
the
Linux
fuse
work
as
an
experiment
was
remarkably
early
also,
but
for
the
mainstream
that
we're
all
familiar
with
three
BSD
was
one
of
the
earliest
players
net
BSD,
with
a
rather
dated
implementation,
followed
by
open
Solaris
dawn
years.
B
Evo
work
that
treated
me
very
well
and
I've
been
running
ZFS
on
a
Mac
for
many
many
years
and
naturally
the
modern
era
were
familiar
with
describe
here.
Much
of
this
has
been
discussed
today,
such
that
well.
Alumnos
has
traditionally
been
pulling
from
itself,
but
it
looks
like
there's
an
announcement
to
truly
unify
over
the
next
few
years.
B
A
moment
ago,
so
the
feature
flag
gap.
This
is
directly
from
net
BSD
and
it
has
remarkable
coverage
on
feature
flags
and
I
believe
in
this
room.
Mathieu
probably
introduced
the
whole
notion
of
feature
flags
to
accommodate
differences
and
you're
winning.
This
is
good.
This
is
very
good.
So,
as
we
work
our
way
up,
FreeBSD
11
actually
I
may
have
done
this
on
12-1,
which
also
shipped
like
12
hours
ago.
So
it
is
working.
B
It's
a
way
to
get
ahead
of,
say:
net
bsd
No
as
of
two
hours
ago,
I'm,
the
osce
no
longer
lacks
native
encryption,
I'm
sure
others,
but
I
haven't
looted
it
up
in
the
while
sitting
here,
but
hey
as
a
new
effort.
That's
been
thinking.
Mac
OS
and
windows
are
remarkably
up
to
date,
which
is
quite
impressive
and
moving
on
to
you
know
FreeBSD
and
zo
L.
It's
like
we're
staying
in
water
and
so
all
in
all
feature
flags
for
the
wind.
B
That
I
believe
is
being
proven
to
be
the
right
approach,
but
in
all
practice
and
all
practicality,
you
want
to
just
sit
down,
install
an
OS
and
have
ZFS
everywhere,
so
naturally,
illumos
and
Solaris
have
had
definitive
route
on
ZFS
and
FreeBSD
brought
that
in
very
early
on
with
Thank
You
Allan
for
installer
support
such
that
it's
a
painless
process.
It's
a
bit
fledgling
on
good
new
Linux,
but
I'll
go
into
details
and
net
BSD.
No,
no
of
that
yet
and
Jurgen
will
describe
the
adventures
on
the
two
least
eunuch
Coss
out
there.
B
So
breaking
news
as
of
the
tenth
I
believe
of
October
moon
to
1910,
shipped
with
experimental
ZFS
support,
and
it's
there
it's
I'm,
not
a
lawyer.
I
will
not
comment
one
bit
on
anything
legal,
related
I'm
here
for
the
tech,
so
I've
deployed
on
a
number
of
systems
it
comes
up.
It
has
two
pools
which
was
interesting:
they've
done
a
boot
pool,
they've
done
a
rest
of
the
OS
pool
and
a
little
about
the
partitioning,
because
there
are
games
that
need
to
be
played
on
any
given.
B
B
Few
months
ago
they
introduced
root
on
ZFS.
They
also
do
with
a
single
pool
which
that's
what
the
user
experience
should
look
like
in
its
a
is
gradually
appearing
like
and
that's
that's
from
months
ago,
and
they
do
have
a
number
of
feature
flags
enabled
right
out
of
the
gate.
That's
impressive!
That's
where
we
want
to
be
so!
B
Is
it
ZFS?
When
you
sit
down
and
say
this
is
ZFS?
Well,
I
did
a
simple
baton
pass
where
I
generate
some
garbage
from
random
and
I
check,
some
it
and
then
I
start
passing
it
between
all
the
systems.
In
the
lab,
so
going
from
I
went
with
the
Z
Olof
abbreviation
to
make
it
more
clear
that
it
is
the
zo
zo
F
work,
but
not
everyone's
heard
that
term.
B
Now
the
Oracles,
the
FS
question
I
started
sending
between
systems
to
and
from
what
I
have
currently
is
a
Oracle,
proper
Oracle,
Solaris,
11
and
11
for
someone
has
11
3
USB
image.
I'll
gladly
borrow
that
and
get
3
in
the
lab,
11
3,
so
I
found
I
could
send
anything
to
Solaris
11.
It
was
remarkably
tolerant
of
even
new
pool
formats
with
feature
flags
which
was
confusing,
but
it
really
didn't
like
to
send
out
elsewhere
or
receive
anything
11
for
that
begins.
B
B
B
So
a
few
numbers-
and
this
has
fortunately
been
touched
on
today-
all
benchmarks
are
wrong
and
especially
if
you're
talking
different
OSS
and
various
experiments.
So
what
you
see
here
is
largely
a
smoke
test,
but
bio
is
not
available
on
Solaris,
yet
they
have
I/o
zone
and
their
various
issues
with
licensing
that
various
distributions
complain
about.
So
I
just
wanted
to
get
out
the
out
of
the
gate,
some
numbers
compression
off
sink.
Always,
let's
look
at
the
worst-case
scenario,
because
you
can
quickly
benchmark
your
ram,
no
problem.
B
B
What
I
can
afford
for
20
machines
is
the
crucial
B
X
500
120
gig
drive
they're
plentiful.
They
have
blocks
written
reporting,
which
is
very
nice,
so
that
gets
interesting
and
it
was
touching
I
believe
earlier
I've
written
to
the
file
system.
Well,
we
compressed
it.
We
did
all
these
wonderful
things.
What
actually
hit
the
device,
because,
with
a
drive
providing
that
information,
you
can
do
a
actual
feedback
loop
like
well.
What
really
took
place?
Don't
save
that
information
to
the
same
device
because
you're
polluting
your
data
as
you
go.
B
B
From
your
local
storage
or
network
storage-
and
they
might
start
off
great
and
somewhat
drop
a
bit,
but
you
ought
again
we'll
talk
about
that
in
a
moment:
ok,
yep,
BST,
ok,
it's
keeping
up
and
if
I'm
not
mistaken,
it
outperformed
the
local
vo
FS,
that's
a
surprise
worth
investigating,
but
we're
triple-digit
there.
How
many
OSCE
I
cannot
explain
why
that
didn't
perform
so
well,
because
you
think
that
is
the
quintessential
implementation.
That's
a
conversation
for
later
boom
to
write
off
it
out
of
the
gate
did
not
perform
well.
That
was
a
surprise.
B
It
is
an
older
dot.
Seven
variation,
certainly
up
not
up-to-date,
Debian
close
to
the
triple
digits
Debian
native,
also
under
for
informed
I,
think
it's
XE
for,
but
whatever
Debian
does
by
default.
I
didn't
want
to
dig
into
that
because
it
doesn't
interest
me
freenas
did
very
well.
I
am
very
impressed
and
in
my
previous
testing
before
him
with
the
last
generation
of
snapshots,
zo
F
was
doing
very
well.
B
So
here's
where
I'd
really
like
to
explore
more
is
anyone
running
ZFS,
unarmed,
I'm,
64
anybody
I've
got
a
wavy
hand
a
few
wavy
hands,
so
the
now-discontinued
soft
iron
overdrive
1000
is
a
great,
affordable
machine
that
a
quite
a
few
open-source
developers
have
across
the
bsds
and
elsewhere
and
the
Zen
folks,
and
it
can
take
two
drives,
which
is
all
I'm
asking
for
so
it's
identical
drives
in
an
arm
64
machine
and
I'm,
pleasantly
surprised
by
that
it's
not
penalized
by
its
different
Ness.
It's
not
analyzed
by
the
fact
that
it's
entirely
different
architectures.
B
So
on
this
note,
these
are
smoke
tests.
Send
me
what
interests
you
I'm
more
than
happy
to
run
a
few
things
in
parallel
against
all
these
machines.
Let
you
know
what
comes
out
of
that.
So,
where
do
we
want
to
be
I?
Think
boot
environments
are
brilliant
and
I
love
to
nest
them
entirely.
Such
the
entire
OS
is
under
a
given
boot
environment.
Even
if
it's
well
freebsd
11:12
head,
you
name
it.
B
Oh
we
can
send
between
the
two
I
would
really
like
to
send
an
OS
from
one
pool
to
another
and
choose
at
boot
time
how
we,
what
we
in
fact
boot
now
I'm,
not
worried
about
open
ZFS
and
all
this
you're
doing
very,
very
well
like
pat
on
the
back
beverages.
Tonight,
you
name
it.
That's
the
part.
That's
working
brilliantly
out
in
the
wild
when
well
I,
work
with
nav
systems
and
look
at
the
competition
and
look
at
what
features
they
support
and
you
ask
questions
like:
oh
so
SAS
multipathing.
What's
that.
B
Software
encryption,
it's
on
a
few
competing
nav
systems.
Fine
native
encryption
is
very
exciting
because
that's
coming
up
in
all
the
medical
fields,
where
there's
a
big
checkbox
that
must
be
checked
and
given
that
the
software
encryption
on
free
is
very
different
from
that
on
Linux
and
I,
don't
know
what
Lumos
is
doing
if
anything
for
software
encryption
anything
nope
for
native,
just
on
any
given
file
system,
something
equivalent
to
galley
or
lux.
Suddenly,
that's
where
ZFS
gets
really
exciting
because
it
you
type
the
same
command
in
a
number
of
OSS
and
good
things
happen.
B
So
in
practice,
I
thought.
Okay,
let
me
jump
in
on
the
Linux
box
and
get
a
the
disk
labels
and
partition
labels
and
I
found
a
lovely,
Stack
Overflow
post
on
the
half
dozen
ways
to
do
that
on
that
OS,
whereas
I'm
familiar
with
all
you
just
type
the
command
that
gives
you
the
status.
That's
that's
what
you
do
so
there
were
a
number
of
choices
on
what
you
could
do
to
get
different
formatting
out
of
and
a
number
of
answers
that
are
all
difficult
to
parse
by
the
way.
B
So
that
said,
I
say
it
takes
a
village.
It's
what's
surrounding
open
ZFS.
That
will
be.
The
challenge
is
moving
forward
and
with
them
boon
to
shipping
with
essentially
read
on
ZFS
here
and
now
those
inboxes
of
yours
and
forums
and
others
will
fill
up
pretty
quickly
with
with
questions
about
these
many
many
things.
So
one
experience
from
my
beehive
work.
B
Grub
didn't
ship
a
release
for
several
years,
just
they
didn't,
and
it
was
very
different
by
the
time
there
was
a
release
and
certain
things
were
no
longer
supported
everything
relating
related
to
grub
to
be
high.
That
lets
you
launch
Linux,
yes,
well,
they
changed
all
the
things
from
under
us,
Oh
partitioning.
Yes,
there
are
a
number
of
tools
for
Linux.
It
there's
a
captive
tool
on
Solaris
format,
and
that
becomes
very
frustrating
when
you've
just
a
moment
ago,
ran
all
the
same.
B
Zfs
commands
you've
run,
maybe
in
the
same
file
commands
all
across
the
whole
spectrum
of
OSS.
And
suddenly
you
want
a
simple
thing
like
a
disk
label
and
it's
it's
a
remarkably
difficult
thing
to
obtain
back
to
the
sass
multipathing
each
OS
handles
that
differently
and
self
encrypting
drives.
Fortunately,
on
newer
things
like
that,
there
are
utilities
provided
by
the
foundations
that
set
these
standards
to
assist
with
that
Oh
on
the
recent
call.
B
The
fault
management
handling
on
FreeBSD
that
ZFS
D
on
Linux
sets
Zed
on
illumise,
that's
fault,
management,
I
believe
the
German
and
they're
all
very,
very
different
and
suddenly
there's
a
post
out
there
proxmox
as
an
as
well.
It's
not
making
any
notion
of
what
you
do
in
case
of
trouble.
Hopefully
that'll
be
resolved,
but
we're
at
the
mercy
of
this
ecosystem.
B
Observability
tools,
perfect
segue
from
the
last
few
talks,
it's
like
wow,
ok,
sometimes
vendors
change,
OS
and
they
invest
heavily
and
all
the
observability
of
one
OS
and
move
to
another
and
think
wait.
This
worked
great
previously
and
and
literally
from
the
last
talk.
The
fact
that
there
are
these
higher-level
interpretations
of
what
you
can
get
from
the
system
are
a
very
good
thing,
because,
hopefully
we
can
hide
all
these
OS
differences
down
below
a
machine.
B
Maybe
a
little
bolt
on
add-on
component
to
properly
obtain
smart
information
presented
to
the
user
as
an
option
because
often
out
in
the
ecosystem,
the
tools
are
not
so
good
and
back
to
arm.
64
I
saw
flyby
earlier
I
believe
Debian
PowerPC
was
it.
That
was
you
in
a
slide.
There
are
still
alternative
architectures
out
there
and
there
were
conversations
earlier
about
risk.
5
other
exciting
new
nicely
license
architectures
coming
online.
B
That's
all
very
exciting
and
I
do
want
ZFS
on
all
the
things,
because
I
want
to
send
the
backup
from
my
phone
or
my
you
name
it
elsewhere.
Powershell
I'll
leave
that
one
to
you
on
PowerShell
hating,
binary
data,
it's
just
like.
No,
we
don't
want
to
do
that,
so
things
like
ascend
from
PowerShell
that
the
the
new
Windows
shell
is
a
challenge
and
you're,
probably
thinking
well
not
my
problem,
not
my
fault.
B
B
C
Okay,
so
I
am
Jorgen,
I
been
working
on
the
Mac
in
the
Windows
ports
and
I
thought
I'd.
Just
take
this
time
to
kind
of
do
a
status
where
we're
at
at
the
moment,
I'm
afraid
I,
don't
have
an
announcement,
so
you
know
call
are
your
expectations
they're?
Their
current
version
for
Mac
is
193,
which
is
almost
identical
to
the
previous
version.
C
192
big
and
the
only
reason
we
had
to
push
this
out
was
because
Catalina
changes
they
made
some
changes
in
the
kernel
that
surprised
us,
which
you
could
argue,
is
my
fault
to
start
with,
but
so
we
pushed
out
a
new
release
just
for
Catalina
in
case
you're
updating
you
should
go
to
193.
First,
we
now
support
Mac
OS
10,
11
Catalina.
We
can
do
earlier
versions
and
well
it
was
just
a
hassle
to
compile
for
every
version.
C
There
is
there's
so
many
now,
so
we
cut
some
off
they're
already
end-of-life
I
believe
anyway,
and
while
I
was
working
on
Catalina
had
a
try,
a
set
up,
booting
said
efest
booting
on
CFS
and
for
the
summer
you
might
know
that
previously
we
had
booting
on
servers,
but
there
were
some
problems
like
fonts,
wouldn't
work,
which
is
somebody
inconvenient,
but
we
found
that
fronts
now
actually
work,
not
entirely
sure
if
I
fixed
something
or
if
Apple
changed.
Something
I
must
admit,
I'm
a
little
bit
tempted
to
go
back
to
see.
C
C
Hopefully
that
goes
well.
We'll
see
we're
waiting
for
freebsd
to
finish
first
and
then
we'll
try
our
version
I
wanted
to
show
a
one
of
my
developers
did
a
gooey
thing,
a
widget
which
looks
like
this.
So
if
you're
gonna
run
ZFS
on
Mac,
there
is
a
little
helpful
widget.
You
don't
have
to
do
anything
command-line,
although
I'm
sure
we
all
prefer
come
online,
but
at
least
it's
something.
C
It
looks
good
right,
no,
okay,
that
does
not
ship
with
the
ZFS
just
yet,
but
maybe
in
the
future
we
can
ship
it
with
it
and
then
on
Windows
we
have
a
version,
2.0
I
think
you're
sexy
version
2.1
to
120
money.
I
make
up
these
version
numbers.
I
figured
it's
alpha,
so
I
can
make
whatever
number
I
want
right.
I
think
of
it
still
as
alpha,
even
though
maybe
I
could
move
to
beta,
but
really
I
don't
want
more
users
to
run
it.
C
Ironically,
I
went
on
the
path
to
figure
out
how
to
do
a
signed
installer,
because
he
have
the
code
sign
on
windows
and
you
have
to
ship
it
up
and
they
stamp
it
and
you
get
it
back.
So
I
wanted
to
solve
that
puzzle
which
was
rather
difficult
that
unfortunately
meant
that
it's
almost
anyone
can
run
it
now,
which
meant
people
are
running
it.
C
What
it
wasn't
really
my
plan,
but
you
know
that's,
okay,
you
can't
boot
it
at
all.
I
haven't
looked
at
booting,
but
I
believe
I
know
how
to
do
it.
It's
just
a
matter
of
actually
one
thing
to
do
it
because
I
have
a
feeling
more
people
who
are
on
it.
So
I
might
wait
for
that.
One
and
I
wanted
to
mention
the
punto
for
Windows,
the
LX.
C
B
C
The
it
took
a
bit
to
make
that
work
on
top
of
ZFS,
which
is
on
top
of
Windows,
but
we
have
managed
to
get
it
to
work,
which
is
nice,
the
reason
I
mention
it
is
because
those
guys
those
developers
have
been
very
helpful
to
basically
try
to
figure
out
some
of
the
problems.
There
are
some
black
boxes.
For
example,
my
nemesis
on
Windows
is
the
trashcan.
C
It's
such
a
useful
thing
to
be
able
to
support,
but
apparently
people
want
to
trashcan
and
it's
been
rather
difficult
to
get
to
work.
Likewise,
on
OS
X,
it's
the
spotlight
that
has
been
the
biggest
problem,
they're
just
black
boxes,
so
you
don't
really
know
why
it
doesn't
work
and
so
on,
I
believe
yeah.
That's
the
status
on
there
to
portrait
I
work
on
this
small
porch,
I,
guess
yeah,
one.
B
It's
a
freely
downloadable
competitor
to
say,
ESXi
and
proxmox,
and
all
the
things
that
it's
hard
to
compete
with
when
there
are
free,
open,
ZFS,
installs,
just
fine
chrome,
installs,
just
fine
and
there's
a
graphical
Windows
server
administration
tool
that
works
just
fine,
so
free
of
charge.
You
can
have
those
things
I've
pretty
much
talked
about
this
last
five
years,
which
is
ZFS
plus
the
hypervisor.
Have
those
will
travel
so
that's
exciting
and
it's
basically
Windows
without
the
candy
crush
Pro
ads
and
other
garbage
that
comes
along
with
proper
Windows.
C
B
So
the
question
is:
is
this
the
best
approach
you've
downloaded
WSL
for
linux
on
windows?
It's
working
with
the
linux,
open,
ZFS,
kernel,
module,
you're,
saying
and
that,
provided
you
essentially
real
ZFS
at
your
fingertips,
but
that's
a
bit
of
a
roundabout
approach.
Is
that
a
better
way
or
should
we
go
native
and
put
up
with
all
the
headaches
of
trashcans
yeah.
C
Oh
I
see,
it
was
for
me,
wasn't
I,
don't
really
think
they're
mutually
exclusive
per
se.
If
you
can
get
the
performance
out
of
there,
the
Linux
environment,
then
you
certainly
run
that
the
reason
I
ported
edifice
of
ZFS
to
Windows
is
mostly
to
challenge
myself
right.
I,
don't
really
think
anyone's
gonna
put
out
huge
storage
and
then
running
Windows.
Maybe
they
are
I.
Don't
know
they
keep
surprising
me,
but
hopefully
both
can
exist.
I
think
that
would
be
nice.
C
Do
I
track
the
number
of
users
and
on
either
platforms
I
probably
should
a
bit
more
I
mean
I
have
all
the
logs.
If
you
want
to
see
all
the
downloads
and
so
on,
we
don't
have
any
callback
code,
anything
like
called
home
code.
There's
nothing
like
that
and
bruders
has
installed
yeah
I'm,
not
sure
why
people
like
doing
binary
installs
from
brew,
but
I
think
on
the
Mac.
It's
in
the
hundreds
and
Windows
is
still
under
a
hundred
right.