►
From YouTube: Ceph Day Germany - Ceph for Big Science
Description
Ceph Day Germany
February 7, 2018
Dan van der Ster, CERN
A
A
And
something
interesting
I
just
learned
the
other
day
from
one
of
my
friends
that
siding
with
some
of
the
agents
that
are
that
great
at
the
collision
point
is
that
this
thing
that
they
call
a
statement
that
upset
Hopkins
have
one
hurts.
It
is
a
similar
kind
of
sentences
through
the
particle
physicists
work
for
a
big
flip,
so
they
haven't
dealt
design
chips.
I
can
tolerate
this
kind
of
this
kind
of
radiation,
which
is
all
over
the
place.
I
guess.
A
A
A
Boxcar
was
working
on,
but
we
also
have
a
typical
IT
infrastructure
with
spring
wanna,
be,
like
seems
all
the
cool
toys,
one
of
them
to
be
set
so
this.
So
this
talk
is
about
set
for
our
IT
infrastructure,
not
set
for
our
50
petabytes
per
year.
I'd
like
that,
but
this
is
about
a
truck
so
all
present
in
the
star
clusters
and
some.
A
Suspension
a
screen
and
watch
storage
spaces
and
some
some
of
our
initials
sort
of
be
back
trying
to
intercept
goodness
so
here's
our
clusters.
You
know
we
started
actually
the
body
years
ago,
its
theft
because
of
this
killer
opportunities
that
lost
origin
of
the
stuff.
That
was
you
know
there
still
is
a
still
defense
tonight,
so
we
have
two
clusters
using
for
that
collection.
A
The
largest
is
five-and-a-half
petabytes
and
then
in
our
second
data
center,
which
is
Budapest,
we
have
almost
half
of
a
petabyte
there
and
those
buses
are
around
half
used
and
distal
running
through.
These
are
the
most
precious
clusters
that
we
operated
in
the
last
after
week,
when
we
trust
all
of
the
disability
receptor
we're
getting
the
really
Interceptor
personnel
as
managed
by
and
we're
really
just
this
for
hyperspace
is
arbitrary.
We
have
between
our
test
cluster
and
and
our
production
cluster.
A
We
had
by
yourself
s
it
more
as
we
just
added
a
third
cluster,
which
is
a
hyper,
diverse
customer
anyway.
Now
we
do
a
little
bit
of
physics
use
cases.
So
this
is
what
the
suspense
here
cast
our
x-ray
P.
So
Casper
is
service,
attack,
system
and
expertly.
It
is
a
storage
sort
of
parking
work
that
we
use
to
build
an
application
on
top
of
the
greatest
yeah.
We
have
a
four
kind
of
a
cluster
and
use
that
one
as
a
buffer
to
to
offer
the
rights
before
they
want
to
tapes.
A
Okay,
and
then
we
have
another
one
petabyte
s3
cluster
that
were
just
sort
of
depression.
I
want
to
get
this
part
of
the
way
just
to
say
that
we
also
do
some
from
time
to
time
we
have
as
as
missus
come
through
the
pipeline.
We
they
arrived
huge
day
these
cases
we
use
them
for
set
for
one
or
two
months,
and
we
did
a
couple
of
over
one
of
the
past
seven
years.
We've
done
these
best.
We
do
thirty
petabyte
tests
while
hammer
and
then
jewel,
and
then
just
before
the
release
of
10,000
OST
tests.
A
A
Three,
these
things.
We
thought
that
without
we
used
to
have
a
or
idea
structure,
reality
appliances
and
PES
appliances,
and
then
we
replace
those
with
virtual
NFS,
Euler's,
okay
and
then
working
very
well
for
us,
so
the
basic
we
have
160
terabytes
of
that
the
basic
stock
is
just
like
Linux
Carlisle
FS
server
ZFS
using
Z
rent,
which
is
a
kind
of
nice
trip,
repeated
replication
across
two
different
server.
These
was
over
at
the
atomistic
on
scenarist,
and
this
ruse
works
really
well.
We
get
actually
really
even
to
the
new
policy
behind
our
big
management.
A
A
A
Play
this
DFS
to
extend
the
file
system,
then
this
is
kind
of
it's
kind
of
boring
work.
It's
also
labor
intensive.
If
somebody
wants
a
new
vibe
they
didn't
have
to
like.
You
know
this.
Of
course
it
expecting
it
restricted,
but
you
know
you
have
to
add
one
for
every
user
and
also
if
one
user
needs
more
performance
not
to
source
base.
If
you
can't,
if
you
have
a
different
set
of
separate
set
of
lines,
as
you
can't
make
a
lot
more
performant,
so
senator
that
supposed
to
know
has
the
most
of
what
we
need.
A
B
A
Developer
then
they
have
users,
get
self-service
interface
to
provision
Saturday
here
from
a
quota
or
or
create
like
say,
tensioners
know
that
you
just
click
that
link
they
get
the
mouth
street
and
they
should
be
snail.
The
performance
right,
seven
messages
daily
stability
at
more
OS
T's
is
more
bandwidth
or
space,
and
if
you
are
meditating
for
this,
you
should
always
just
add
more
advances.
We've
been
testing
this
in
sort
of
pre-production
with
around
20
users
since
the
middle
of
last
year,
and
of
course,
is
single
NTS
was
all
abacus.
A
A
Storage
interface,
it's
a
problem
for
us
work
together,
so
said
the
best
need
to
plug
in
there
any
students
working
on
that
here's.
A
couple
of
pictures
showing
multi-ethnicity
production.
Yes,
so
I
said
that
we
have
we've
had
these
two
active
instances,
we
have
created
the
picture
of
the
most
work
status.
A
B
A
Why
I
think
that
the
counting
of
underclasses
different
problem
from
Joseph
this,
but
basically
even
the
spread
the
load
evenly
across
each
other
so
set?
Has
a
built-in
ballast
r2d2
disbalance
the
men
appear
to
users.
We
didn't
do
anything
in
their
business
option
called
NPS
balance
intervals,
equal
60.
So
this
is
how
often
that
set
looks
at
different
directions
in
the
size
to
around.
They
seem
just
a
little
bit
smaller
than
the
default,
but
yeah
it
was
just
nicely
seated
it
renowned.
Something
is
really
kind
of
like
magic.
A
B
A
A
That's
this
does
so
you
know
nothing.
It's
not
perfect,
studying
something
on
our
wish
list.
The
block
storage,
these
case
that
is
so
successful.
It
is,
in
my
opinion
it
successfully.
Doesn't
it
works
really?
Well,
it's
good,
but
also
because
you
can,
if
you
have
a
huge
enterprise
environment,
you
can
do
these,
like
controls,
quality
service
models
on
other
clients,
so
you
could
really
trust
that
no
one's
gonna
start
at
the
an
attack
volume
and
then
also
it's
your
cluster.
A
B
A
A
Other
side
yeah,
maybe
like
now
something
like
HTC
instead
of
s
so
starts
mostly
the
Hyperion
computing
lab.
So
we
we
have
embarrassingly
parallel
we're
closed.
That
means
that
there's
not
this
but
the
basic
particle
physics
works
or
glues,
there's
no
message
possibly
to
the
jobs.
They
just
open:
a
file,
processing
versus
smaller
quality
right
there,
just
identity
data
to
storage.
A
So
actually
you
know
these
kind
of
workloads
are
are
taller
and
storage
is
not
like
perfectly
positive
or
perfectly
consistent.
I'm,
sorry,
have
you
build
different
storage
systems,
but
there
are
several
HPC
corners
in
our
lab
people,
doing
like
simulations
of
the
beads
or
accelerator
physics
or
quantum
chromodynamics.
Okay,.
A
A
Here's
one
of
these
use
cases
just
like
is
interesting
about
so
this
isn't
one
of
my
friends,
that's
doing
the
computer
for
the
for
the
easy
design
and
the
CMS
experimentation.
He
showed
us.
The
supplies
he's
got
and
one
hand
up,
I,
don't
know
what
that's
called
like
slice
of
the
detector
is
different
changed
a
lot.
We
designed
custom
for
a
person
and
there's
like
millions
of
these
chips
when
they
were
the
design,
the
chips
managers
who
designed
them
for
the
different
processors
sizes.
A
A
So
they
need
just
to
be
able
to
to
check
better
designs
before
saying
that
they
need
like
12
times
more
CPU
power,
and
you
can't
do
that
all
my
box,
they
visiting
the
skelter,
but
that
did
the
skillet.
This
is
one
is
that,
where
the
arrow
now
surge
approach
to
maybe
HPC
is
not
to
buy
prefabricated
supercomputers.
Today
we
like
to
build
agency,
like
you,
already
be
able
to
monitor
parts
that
she
was
a
possible.
So
that's
like
software-defined
agency,.
A
B
A
It
seems
to
work
and
the
users
no
comparable
performance.
So
there's
no
like
real
Tennessee,
80
bucks.
We
have
seen
crashes,
we
haven't
seen
a
the
corruption
said
once
I
think
where
these
are
said
that
who
might
like
this.
This
fall
back
and
has
zeros.
Is
that
what
I
expected?
And
then
it
was
anything
like?
Maybe
we
have
to
run
captions
over?
They
belong
to
consciousness
like
this,
like
in
general.
A
It's
working
so
now
is
rubbish
like
that
NFS
delivering
these
gates
that
we
have
an
Irish
receives
or
space
that
we
have
just
turned
into
the
same
sort
of
as
a
second
best
service,
so
that
HTC
is
just
another
user
are
or
by
their
surface,
but
you
know
liked
also
with
the
performance.
So
I
was
intrigued
by
a
few
months
ago,
someone
posted
on
the
set
that
was
this
son
identified,
a
benchmark
that
they
are
trying
to
promote.
A
A
These
are
running
on
servers
where
we
have
four
SSDs
per
server
and
two
SSDs
are
going
to
like
the
compute
side
of
things
and
the
two
SSDs
are
going
to
set,
and
this
is
like
we
just
installed
seven
and
just
prepared
the
u.s.
DS.
We
didn't
know
what
to
name.
We
need
them
to
be
forgot.
Oh
yes,
so
we
just
started
some
vienna's
clouds
around
any
guesses.
Okay.
So
this
is
not
like
a
well-designed
set
cluster.
This
is
just
let's
just
it's
all.
A
It's
okay
and
indecent,
so
these
are
these,
are
massive
supercomputers
have
been
designed
by
teams
of
engineers
to
get
the
maximum
storage
to
put
possible,
and
you
know
so.
If
we
compare,
this
is
a
we're
not
that
far
for
only
were
half
as
good
as
them
with
our
gist.
You
know
to
a
cluster
that
were
just
deployed
one
day:
I
see
that
you
know
throughput
wise
things
are
pretty
okay,
but
it's
not
really
relying
quite
a
bit
behind.
A
So
this
is
like
our
store
was
like
1.4
gigabytes
per
second,
we
had
been
one
of
the
customers,
but
this
is
my
house
is
right
to
the
size,
so
we're
like
we're
quite
a
bit
behind
the
next,
the
next
cluster.
So
I,
don't
know
this
was
fun.
This
is
fun
to
do,
but
actually
we
would
like
to
work
actually
with
the
developers
to
make
this
better
I
think
this
is
and
that
percepted
could
make
a
big
impact.
A
Funding
them
there's
somebody
like
inputs
or
software
that
you
download
and
people
want
to
build
services
out
of
this,
and
they
just
come
with
an
s3
storage
like
that.
So
at
some
point
it
becomes
a
better
saving
to
earth.
If
you
don't
offer
testing
services
guys
so
now
now
we're
using
like
these
that
offers
us
is
that
we,
so
we
just
use
it.
So
we
basically
run
a
pretty
technical
set
cluster,
and
then
we
have
10
again
exactly
the
state
recently
started
source
copies
as
needed,
and
they
all
just
live
in
a
cname.
A
C
B
A
A
A
A
B
A
A
We
have
one
idea:
one
of
the
2014
has
an
idea
for
a
better
H,
a
toxin
traps
daily
creation.
So
now
in
this
er
as
a
service
map,
so
every
time
you
arouse
it,
we
start
something
registered
cells.
Inside
of
here
this
is
my
URL
I'm
ready
to
serve
you
the
way
that
we
rule
the
summer,
today's
it
as
well,
so
we
serve
use
of
it.
We
wouldn't
need
em
public
configures
that
machine
and
exports
of
resources.
Another
saying
that
now
by
a
puppet,
this
thing
exists.
A
So
then
all
the
other
contain
proxies
discovered
by
itself
invitation
to
restart
and
other
services
atmosphere.
This
process
takes
a
couple
of
hours.
Actually,
so
it's
not
very
dynamic.
Now
the
idea
is
to
use
a
service
map.
The
steps
are
was
not
to
trigger
this.
So
basically,
the
respondent
arrested
mr.
A
They
see
us
T
happens
to
know
how
to
do
it.
People
respect
a
necessity,
records
to
disparities,
browse
gateways
and
then
basically
visible.
This
very
short
have
to
get
the
states
into
production
in
just
seconds.
So
if
this
looks
like
it
could
work,
maybe
she
tried
now
I'm
sorry
to
eat.
So
this
isn't
our
currency
as
well
as
a
few
days
ago,
using
an
open
stock
sitting
there
volumes
with
set,
so
we
have
something
will
close
the
four
thousand
images.
A
These
are
the
system,
images
or
snapshots
of
running
systems,
and
we
have
volumes
detached
volumes
and
users
of
story
in
their
databases
or
data
file,
so
whatever
they
need
for
applications.
The
plot
is
going
from.
The
last
is
like
it's
gonna
be
a
2016
up
to
now,
so
you
can
see
like
an
increase
in
the
number
of
I
officers.
Can
cluster
with
some
glitches
online
and
increases
steadily
recently.
A
Where,
where
I
start
to
sweat,
is
that
I
look
at
the
right
dates
very
closely
so
over
on
the
beginning,
our
goal
is
in
our
blocks.
Our
service
is
to
be
taking
write
performance
which
is
like
equivalent
to
a
level
attached
disk
so
like
on
a
hundred,
basically,
which
is,
which
means
that
you
have
to
wait
to
see
below
around
20
seconds
and
that's
how
I
was
at
the
beginning.
But
then
over
time
is
slowly
crept
up
as
users
reducing
has.
Then
we
change
the
hardware
completely.
We
operate
the
hardware
which
brought
it
right
now.
A
We've
got
a
couple
of
times
capacity,
but
now
elsewhere
the
latency
is
creeping
up
and
we,
you
know
we
need
to
find
a
new
solution
to
die-offs
capacity,
so
just
wrap
up
just
to
say
that
these
use
cases
are
working
reliable
of
this.
Basically
there's
variable
in
certain
place.
You
know
we
don't
have
a
big
supporting
offer,
but
anything
right,
except
for
block
storages,
it's
quite
reliable.
A
C
A
A
A
So
you
know
just
by
yourself
like
this
week,
really
excited
about
and
we're
also
now
you
on
the
other
side.
My
colleagues
is
right,
driver
for
clients
so
that
we'll
get
back
our
TV,
which
is
here's
some
news
of
individuals
with
this.
So
for
the
possible
death,
great
things
were
quite
uneventful.
I
did
notice
that
you
know
I
think
that
anyone
that's
from
the
Centaurs
problem
is
that
it's
not
usual
at
this
time,
like
the
communities
restart
when
you
upgrade
the
area
and
actually
it's
doing
it
too
early
I
think
this
is
something
your
clusters.
A
B
A
A
C
A
A
Or
its
space
to
use
on
rusty,
so
at
least
all
those
things
together
than
starts
to
do
things
for
you,
because
it's
based
on
these
crush
movies.
It's
still
a
bit
imperfect,
so
that
up
map
is
like
birds.
Solution
by
pop,
that
requires
of
all
of
their
clients,
are
the
witness,
so
here's
the
basic
recipe
for
divas
so,
for
example,
introducing
Prescott
that
you
would
say,
if
said
consequence,
compactness
FL
so
on,
and
then
things
it
just
happened
to
see.
A
A
We
still
have
this
question
of
how
to
replace
main
universities,
so
this
is
a
old
jool
days
using
our
spirits,
how
you
replace
three
petabytes
servers
with
six
megabytes
of
we
might
Harbor
over
several
weeks
so
like
this,
all
of
the
last
shows
adding
capacity
to
cluster
and
the
drain
also
hold
servers
with
adding
another
lack
of
Jenny
automatic,
a
dream
and
the
right
shows
space
use
on
individual
disks,
some
missus,
basically
down
the
biggest,
is
Stacie
Royer
that
it's
not
obvious
how
to
do
this
with
her.
Yet
we
did
try.
A
So
the
idea
is
that
you
should,
just
in
the
past
of
you,
just
padding
a
whole
rack
of
servers.
This
would
be
really
destructive
to
your
clients,
but
I
think
with
luminous
the
idea
that
it
should
be
okay,
as
the
items
are
prioritizing
it
see
what
the
goal
is
the
best
how
this
so
we
try
it
with
one
dragging
one
server
to
our
history
cluster
and
it
was
basically
transparent
agency-
was
heisted
notice,
but
it
did
take
five
days.
Tobacco
was
hurt.
This
is
probably
a
long
time
and
then
there
was
some
issue.
I.
A
Think
that
there's
some
bug
related
to
the
way
it
is
decided
in
which
objects
to
move
in
which
order,
because
during
this
is
eventually,
we
had
five
million
created,
which
is
just
unusual
there's
also
by
the
way
just
is
just
like,
if
you
notice
every
there's
a
bus
or
Pisa
you're,
activating,
possibly
not
a.
This
is
like
a
hot
issue
at
the
moment
to
quite
this
tractor
later
than
all
of
the
instructions.
A
A
Not
a
literally
be
back
with
a
second
jewel
which
is
in
luminous,
it's
the
preferred
way
to
prepare.
Was
these
like
to
inform
regularity
or
this?
This
is
how
things
work:
vegetable,
okay,
if
you're
an
admin
and
you've
logged
into
the
server-
and
you
want
to
say
man.
What's
on
my
system,
what
are
the
disappear
and
probably
like
how
to
use
or
even
a
list
of
all
the
devices
to
sd
cities
of
journalize?
A
B
A
So
you
know
seconds
movies
worth
of
usability
direction,
but
you
know
is
still
in
progress
from
here.
It's
really,
you
know
this
is
designer
fidelity,
an
expert.
Not
me.
Also,
you
know
we
can
I.
Don't
know
you
can
tell
me
go
to
it,
which
this
is
the
one
is
the
broken
one
you
can
can
tell
there's
no
dead,
sta,
there's.
No,
so
sloppy
mercilessly
got
to
Israel
he's.
A
Also
simulates
almost
like
interested,
maybe
have
to
alter
to
find
radius
and
then
using
flash
I
mean
you
need,
there's
no,
there's
no
simple
tool
to
just
say:
I
want
this.
I
want
this
listening
to
you
say,
mystic
quest
just
to
do
it
for
one
line,
especially
its
this
day.
So
I
did
like
it's
better
now,
just
very
good.
These
plugins
on
reference
Sonya,
where
these
languages
examine
and
if
anyone
else
hears
is
like
I
could
have
until
we
meet
monthly
to
share
our
services
with
what
the
similar
news
cases.
A
It's
actually
a
couple
of
links
parrots.
You
can
get
more
in
both
just
plugging
one
of
our
closest
friends
in
South
Africa.
They
are
building
something
called
the
East
where
television
operating,
which
is
huge
like
radio
telescope,
and
there
is
except,
except
for,
like
a
smaller
version
of
the
severe
weather
break.
C
A
A
Stripe
width
function
to
make
that
and
we
just
tested
a
switch.
The
progress
we
to
see
what
was
the
look
at
the
rainy
City
and
everything
all
of
scrubs
and
understand.
West
I
started
so
I
got
me
to
that
long
ago,
which
was
probably
in
the
Hanna
days,
and
we
just
have
an
updated
configuration
since
ten.
So
it
seems
to
be
okay.
A
A
C
A
Yeah,
you
should
look
at
the
site.
I
think
John
really
make
a
lot
of
innovation
errors.
The
mechanism
is
really
cool,
basically
every
young,
ok.
So
what
do
you
want?
Do
you
want
each
client
to
get
a
different
set
of
XP
right?
You
don't
want
to
create
a
rule
for
every
user
right,
that'll
suck.
So
that's
why
I
realize
no
houses
may
contain
spaces.
So
we
can
one
rule.
You
can
have
multi-tenancy
control.
Ok,
so
that's
all.
A
If
you
have
several
users
easy
one
to
they'll
rate
their
objects
to
what
we
different
need:
space
metal,
which
is
actually
just
the
object
prefix,
then
you
don't
want
master
users
to
connect
to
the
MDS
and
do
weird
that
is
around
anywhere
these
days
right.
So
the
MDS
has
a
capability
that
hasn't
passed.
Even
this
is
here.
B
A
Next
to
a
prefix
in
the
politics
of
the
state
space,
yes,
so
so
basically
end.
These
are
crystal
website
a
place
to
share.
That
is
indeed
that
can
amount
the
second-best
prefix
in
a
new
space,
great
school.
So
this
nice
legs
completely.
It
means
it's
not.
It
means
it's
creating
them
by
their
own
personal
Tyler.
It's
not
a
shared.
It's
not
a
shared
file
system
to
be
accessed
by
anyone,
and
then
you
authenticate
by
covers,
but
that's
not
like.
That's
all
it
is
it's
a
unique
empty
and
if
that's
like
service
for
each
user.