►
From YouTube: Email Storage with Ceph - Danny Al Gaaf
Description
Cephalocon APAC 2018
March 22-23, 2018 - Beijing, China
Danny Al Gaaf, Deutsche Telekom Senior Cloud Technologist
A
B
B
So
it's
an
S
phase
since
heavy
Charlotte
to
make
it
work
at
all,
and
we
have
currently
on
the
system's
49
million
accounts
from
the
customers
that
may
run
about
1.3
petabytes
of
storage
for
emails,
real,
and
that
makes
something
around
six
point:
seven
billion
emails
system
and
it's
drawing
was
growing.
The
reason
is
quite
a.
B
Have
to
some
months
or
years
ago,
the
policy
to
delete
phase
of
the
90
days,
and
now
we
have
another
source
of
correct
posture
and
besides
that
needs
something
around
1.2
billion
cash
and
minutes
to
make
it
work,
and
the
system
provides
not
about
32%
of
usable
storage,
so
the
rest
is
for
replication
and
so
on.
If
you
take
a
look
on
NFS
operations,
you
will
very
easily
see
that
there
are
a
lot
of
Corrections
that
are
made
a
lot
of
operations.
B
You
don't
really
need,
but
they
are
there
and
you
have
to
handle
them,
and
so
a
lot
of
that
is
made
another
version.
Only
something
around
these
two
logs
here
called
20%,
already
I
all
right
and
reads,
as
you
can
see,
on
the
NFS
traffic
at
the
end.
So
ok
is
still
that
you
have
to
optimize
your
system
for
the
whole
Isles
and
as.
B
B
B
Accounts
so
if
I
get
an
email
from
amazing,
this
is
probably
much
smaller.
The
enemy
system,
email,
section,
6
megawatt,
not
told
us
how
like
in
India,
they
didn't
come
to
the
basis
that
they
came.
Probably
why
I
am
ad.
So
how
are
you
bet?
Storage?
Usually
they
only,
but
once
because
there
are
no
change
week.
Many
many
miss
relative
I
mean
how
much
often
do
you
meet
your
email,
it's
probably
once
and
second
time,
maybe
underneath
it
it's
stored
and
mail.
B
Your
mailbox,
everybody
knows
that
machine
and
the
usage
for
a
storage
and
our
system
highly
depends
on
what
the
customers
doing.
So
it's
different
for
different
protocol.
That
is
different
if
it's
a
protocol
odds
to
have
mail
system,
so
it
produces
different
load
and
usually
a
meta
data
store
different
place
and
it's
very
freely
pass
loss.
You
lose
your
mailboxes,
you
can
recover
in
a
box,
but
you
don't
know
if
they
you
use
are
created.
Any
directories.
C
B
We
read
an
email
if
he
forwarded
emails
or
for
a
customer.
It's
not
really
fun
to
get
in
a
situation,
and
yes,
this
or
any
attachment
is
very
easy
to
Google
compress.
So
what
does
all
motivation
to
do
something
different?
So
for
sure
we
want
to
have
pasta.
Automatic
self-healing
correctly
and,
as
sister
was
great
underneath,
can
get
fast,
very
critical.
We
want
to
have
less
words.
We
want
to
get
rid
of
to
be
kind
of
operations,
so
we
want
to
get
out
over
and
over
and
we
currently
f.
B
So
if
you
take
a
little
self
I
don't
need
to
all
right.
So
people
see
it
very
often
these
days.
Where
could
we
store
email?
It's
one
would
be
to
use
a
class
right
so,
but
at
the
end
it's
the
same
as
address
it's
the
posix-compliant
to
basics.
People
do
the
same.
You
have
to
say
my
overhead,
so
the
posits
that
is
adding
the
same
complexity
as
before.
Also
for
emails.
From
our
point
of
view,
it's
not
an
option,
but
you
can
easily
use
it
for
method
on
our
cash
flow
index.
C
B
Use
a
beanie,
but
that
means
family
or
regular
Japanese,
which
complicated
and
at
the
end,
you
always
reach
a
point
where
you
have
my
to
migrate
accounts
or
it
will
have
the
already
extended
or
file
system
on
they
are
in
the
external
and
at
the
end,
also
the
truth
again
under
the
RVD
and
focus
file
system
and
it
doesn't
change
anything
acharya
sharing
between
clients,
home
romances.
That
was
not
that
easy
and
practical
security
visor
would
be
your
best
solution,
because,
yes
about
polarization
again
between
that's
created-
and
you
know
so,.
B
B
B
B
B
It
has
a
very
large
market,
e-mail
system
that
a
small
solutions
and
it's
thrown
it's
very
large
and
it
already
has
a
standard
4x4,
but
the
only
sports,
s3
Gosford
and
that's
all,
that's
all.
That's
the
so-called
enterprise
teacher
I,
don't
know
what
my
feeling
is.
This
model
steps
to
open
source
software
and
happen,
enterprise
which
I
have
to
pay
for
destro
source.
B
It
requires
at
the
end
a
pro
license,
and
that
is
pay
per
account
and
there
is
due
to
policies
from
the
company
providing
support,
no
discount
or
number
of
accounts.
So
you
pay
probably
the
same
if
you
get
10
accounts
and
we
have
to
pay
the
same
as
you
get.
39
million
accounts
not
really
possible
and
it's
complicated,
it's
very
complicated-
to
set
up
local
caches
in
between
and
not
easy
to
handle.
So
we
did
something
else.
So
we
decided
there
is
no
form
a
system
wasn't
an
option.
B
For
the
development
and
counseling-
and
we
have
a
company
called
talents
which
was
already
maintaining
all
mr.
frost,
and
so
they
do
development
from
us
and
we
selected
sufi
for
the
second
part
so
give
orders
and
plugin
from
ontraport,
and
it
first
that
we
selected
a
hybrid
approach.
That
means
we
put
the
emails
in
nerado's
directly
and
put
you
mate
a
little
sack
of
us,
so
we
have
to
justice
for
that.
B
C
B
B
They
are
all
part
of
the
human,
as
I
said
before,
that.
Don't
change
Emma
and
this
part
is
thought
and
Radha.
So
we
don't
need
to
mark
anything,
but
we
have
a
bunch
of
information
on
an
email
like
when
did
it
arrive?
Some?
You
are
these
first
performers
made
system
sizing
information
and
so
on
that
stone
actually
in.
B
B
A
little
tool
to
get
the
information
all
the
products
that
this
reflected
forward,
an
email
looks
like
a
lot.
It
could
get.
The
same
information
directly
was
come
on.
It's
basically
written
to
make
it
easier
for
the
administration,
and
we've
also
brought
in
dictionary
to
use
the
home
of
key
value
store
and
the
idea.
B
That
we
later
in
the
second
step,
what
to
get
rid
of
servers,
we
want
to
use
the
movement
for
metadata
information
and
caching,
and
so
on.
So
it's
sauce
I
said
it's
also
an
agpa,
it's
written
in
C++
and
it's
already
available
on
people
so
and
we
support
several
versions.
Basically
because
permits
to
is
not
running
on
the
latest
version
of
code.
So
there
are
different
reasons.
People
support
all
of
them,
but
I
have
three
markets
still
under
development.
B
It's
not
completely
finished,
so
if
you
want
to
use
it
in
production,
I
would
say
don't
and
the
r
package
is
all
ready
for
ya.
Obviously,
so
first
we
saw
what
categories
should
be
used.
What
features
do
we
have?
So?
Yes
for
sure
we
need
glue,
guru,
store,
performance-wise,
we
needed,
and
it
should
be
in
many
use
cases
faster
than
five
score
right
for
some
of
us.
We
also
have
some
requirements.
We
need
a
stable.
A
B
B
B
B
C
B
Each
machine
has
two
times:
10
G
4
times
negative
x,
dual
port
heavy
for
a
network,
so
40
G
benefit
is
not
really
the
problem.
That's
always
I
wanna
email
systems,
so
we
have
some
SSDs
for
wood
and
we
only
have
true,
as
recommended
Tony
in
HDD,
and
no
work
on
world.
In
there
we
have
two
types
of
of
nodes:
we
run
there,
so
one
type
of
node
is
warning,
and
yesterday
was
D
is
basically
the
same.
B
B
B
C
B
This
nothing
special,
we
selected
relatively
smallest
because
you
want
a
better
distribution
on
small
area,
alright,
so
yeah.
You
probably
know
why
that
specific
hardware,
if
you
take
a
look
on
the
community
recommendation,
which
is,
from
my
point
of
view
not
really
up
to
date,
but
that's
that's
much
different.
What
we
have
so
properly
Mumma
is
an
overkill
or
hydroxy
dues.
B
At
this
extent,
you
must
know
that
an
mes
performances,
mostly
CPU
clock
board,
because
it's
partly
single
for
it
and
that's
a
problem.
So
you
won't
work
like
locked
cities,
single
thread
performance,
mostly
in
schools,
high
performance
on
this
project,
so
an
overstep
more
honest
or
sparkling.
So
it's
not
the
point
so.
B
B
C
C
B
Don't
have
to
program
his
rights
and
falsetto
caste,
whose
replication
and
put
them
in
the
collocation
room
since
the
form
even
any
final
sizing.
We
only
need
15
as
ASCII
notes
and
that's
easy
to
create.
So
the
problem
of
the
three
missing
room
or
not
the
room
that
has
not
the
same
availability
is
not
that
big.
So
we.
B
B
B
A
B
So
we
have
to
read
make
sure
that
the
Graduate
coding
is
the
right
one
and
the
settings
on
our
icon
and
the
performance
is
fitting
and
that
nothing
goes
loss,
because
it's
not
that
easy
to
make
a
copy
of
an
email
and
do
a
backup,
especially
the
European
progress,
is
also
currently.
So.
It's
the
case
that
if
the
user
deletes
an
email
I
got,
four
would
have
to
make
sure
that
it's
instantly
also
deleted
in
the
background,
and
that
is
something
that
is
tricky.
B
A
B
But
very
soon
I
guess
and
probably
be
also
very
optimized
harder,
because
it's
probably
over
that
you
can
reduce
it.
So
we
have
some
topics
in.
We
need
to
solve
and
didn't
solve
yet
so
variation
cooling
is
one
so
especially
the
effect
which
rate
are
cooling
are
using,
so
we
need
to
do
run
performance
tests
and
especially
about
what
kind
of
profiler
on
there
and
we
need
to
optimize
it
somehow
for
its
moral
rights
right
I
mean
even
50k
is
more
right
for
ethically
compression
is
one
topic
we
would
like
to
use.
B
That
I
would
like
to
avoid
it.
Yeah
classic
event
was
a
topic
we
currently
discussed,
especially
not
for
a
client's
part
for
a
back
end.
So
we
need
to
see
how
fast
we
can
recover
a
class
colleges.
Seventy
percent
full-
and
it's
probably
something
we
need
to
know
as
more
network
panelists
here
and
what
topic
we
have
added
a
real
progress.
It
is
not
a
free
market,
it
is
not
to
generate
or
four
emails.
So
that's
a
little
tricky
to
produce
a
real
life
test
for
that,
but
we
discussed
this
topic
so.
A
C
B
B
B
B
B
Cashing
in
able
to
decline
machines,
but
you
only
want
to
have
for
emails
and
for
indexes
one
solution
that
swallows
and
that's
very
working
for
so
what
conclusion
can
I
make?
We
are
ready,
confident
that
it
can
replace
NFS
for
emails,
because
we
will
save
a
lot
of
Io.
You
probably
don't
get
to
report,
maybe
only
half
there
I
hope
we
need.
B
That
will
be
a
little
bit
more
as
an
overhead,
but
we
we
are
sure
that
we
can
say
at
least
hard
for
75%
of
the
I/o
currently
in
this
area,
and
that
makes
us
a
different
solution.
Remoteness,
Colorado's
protein
has
to
go
to
service.
We
will
use
through
store.
We
will
probably
also
test
the
hosts
file
store.
Only
to
get
numbers
won't,
be
a
normal
store
and
for
errors
recording
and
regarding.