►
From YouTube: Intro to Elasticsearch Operator for Kubernetes Peter Brachwitz (Elastic) OpenShift Commons Briefing
Description
Introduction to the Elasticsearch Operator for Kubernetes
Guest Speaker: Peter Brachwitz (Elastic)
Host: Diane Mueller (Red Ha OpenShiftt)
November 23, 2020
The Elasticsearch Operator or ECK is built and maintained by the creators of Elasticsearch, it does a lot more than manage Elasticsearch though. The operator can help you automate the deployment, management and upgrade of Elasticsearch, Kibana, Beats and Enterprise Search. Since making the operator generally available in January 2020, we have consistently added value to our customers by releasing new features and partnerships, like the RedHat Certification most recently.
In this Briefing, learn about how the ECK operator can help you automate the Day2 operations if you are running the Elastic Stack and Solutions on Kubernetes.
A
Hello,
everybody
and
welcome
to
another
openshift
commons
briefing
as
we
like
to
do.
On
monday.
We
bring
in
other
projects
products
and
have
people
give
us
a
an
intro
tutorial
overview
of
what
they're
doing
and
we've
all
probably
heard
of
the
elk
stack
or
elastic
and
all
of
those
things.
But
I
thought
it
was
high
time
we
got
an
update
on
what
was
going
on
in
the
elastic
cloud
and
especially
since
they've
now
built
an
operator,
so
we
have
peter
brockfitz,
who
is
here
with
us
from
vienna?
B
A
But
we're
gonna
have
him
talk
for
and
give
us
an
intro
tutorial
to
elastic
cloud
on
kubernetes
and
we'll
have
some
demo
and
then
there's
time
at
the
end
for
live
q
a
so
wherever
you
are
on
facebook,
twitch
youtube
or
here
in
bluejeans.
Please
just
ask
your
questions
in
the
chat
and
we
will
really
relay
them
to
peter
and
have
a
conversation
at
the
end,
so
welcome
everybody
and
peter
go
for
it.
Take
it
away,
introduce
yourself
and
let's
hear
all
about
elastic
cloud.
B
Yeah
thanks
dan
for
the
introduction,
so
my
name
is
peter,
as
you've
heard.
I'm
a
software
engineer,
I'm
working
for
elastic
on
what
we
call
elastic
cloud
on
kubernetes,
and
it's
also
what
I'm
talking
about
today
me
see
if
I
can
watch
my
slides,
so
the
elastic
cloud
and
kubernetes
is
a
v-way,
the
official
way
to
run
the
elastic
stack
on
on
kubernetes,
and
maybe
it's
worth
sort
of
taking
a
step
back
and
and
reminding
ourselves
what
we
mean
by
elastic
stacks.
B
And,
of
course,
we
have
a
sort
of
window
internet
stack
through
kibana,
which
is
a
sort
of
extensible,
visualization
and
ui
application,
and
that
enables
the
three
solutions
we
we
currently
have,
which
is
enterprise
search,
which
gives
teams
the
ability
to
unify
sort
of
data
from
multiple
data
sources
into
a
unified
search
experience
or
allows
them
to
add
a
search
box
to
their
application.
That's
powered
by
elasticsearch
and
elastic
observability,
which
is
what
we're
looking
at
closer
today.
B
Also
during
the
demo
later,
which,
of
course,
the
ability
to
observe
your
infrastructure
through
logs
metrics
application,
performance,
monitoring,
data
and
uptime
data,
and
things
like
that,
an
alert
on
it
and
finally
elastic
security,
which
is
a
sim
solution
and
has
also
an
endpoint
component.
So
all
of
these
have
also
small
binaries
or
processes
behind
it,
which
is
something
to
keep
in
mind,
because
what
we're
interested
in
is
actually
orchestrating
this
later
on
on
kubernetes.
B
B
B
I
want
to
run
this
product
and
that
product
and
tell
us
how
many
resources
you
want
to
use
and
we
take
care
of
the
rest
now
it
could
be
that
for
some
one
reason
or
another,
regulatory
or
legal
or
some
other
requirement,
you're
not
able
to
run
on
a
public
cloud
or
and
have
the
requirement
to
run
on
your
own
infrastructure.
And
this
is
where
elastic
cloud
enterprise
comes
in
as
an
on-premise
version
of
elastic
cloud.
B
And
finally-
and
this
is
what
we're
focusing
on
today-
elastic
cloud
on
kubernetes,
which
aims
to
give
you
a
similar
experience
as
elastic
cloud
enterprise,
but
on
kubernetes.
So
today,
elastic
cloud
on
criminalism
is
just
an
operator
and
a
kubernetes
operator,
it's
available
on
operator,
hub
io
and
with
the
latest
release.
It's
also
going
to
be
a
red
head.
Certified
openshift
operator.
B
Well,
you
could
say:
can
I
not
just
create
the
necessary
kubernetes
objects
myself
to
run
these
applications,
and
the
answer
is
yes,
maybe
for
simple
use
cases,
but
as
soon
as
we
think
about
sort
of
beyond
a
simple
proof-of-concept
deployment,
it
becomes
clear
that
sort
of
we
need
more
power
and
more
capabilities
to
run
this.
Let
me
illustrate
this
by
going
back
to
that
slide.
B
We
looked
at
just
earlier
and
looking
at
this
slide
again
and
think
about
what
kind
of
applications
are
these
and
what
requirements
do
they
have
in
order
to
run
them
as
an
orchestrator
so
which
of
these
applications
are
stateful
and
which
of
them
are
stateless
and
then
realize
that
leicester's
elasticsearch,
of
course,
sort
of
at
the
center
of
this
is
the
stateful
application
that
all
the
others
are
relying
upon
to
persist
this
day.
But
this
is
also
the
most
interesting
application
from
an
orchestrator
point
of
view
and
which
is
what
I'm
focusing
on
today.
B
Mostly
so
kubernetes,
of
course,
has
support
for
stateful
workloads
in
form
of
stateful
sets,
but
there's
other
things
to
take
into
consideration
right.
So
we
need
to
start
thinking
about
storage
to
persist
the
state.
So
we
need
to
think
about
volume
management.
We
need
to
think
about
choosing
a
storage
provisioner
that
has
offers
good
enough
performance
for
an
application
like
elasticsearch
and
then-
and
this
is
the
other
focus
of
this
presentation-
I
guess
is
you
need
to
think
about
what
happens
after
you've
initially
deployed
this
cluster?
B
What
if
your
requirements
change
you
need
to
scale
up
or
down,
or
you
want
to
change
the
architecture
of
your
cluster,
because
you
have
a
new
use
case.
You
want
to
incorporate
and
then
I
think
it
becomes
clear
that
we
need
sort
of
take
extra
into
consideration
that
not
all
elasticsearch
clusters
are
uniform.
B
B
They
play
all
the
roles
together,
but
as
your
as
your
use
of
a
cluster
grows,
what
people
start
to
do
is
sort
of
factoring
these
out
into
different
tiers.
So
then,
you
have
suddenly
a
cluster
where
not
all
nodes
are
uniform
anymore,
but
they
have
different
roles.
So
one
thing
people
tend
to
do
is
sort
of
pull
out
the
master
nodes
in
a
dedicated
set
of
nodes
just
to
isolate
them
from
any
spikes
and
traffic
and
make
sure
that
your
cluster
stage
stays
available
at
all
times
and
then
as
more.
B
You
move
it
over
time
to
cheaper
hardware,
that's
maybe
a
little
bit
slower,
but
as
the
data
becomes
less
relevant
for
you,
that's
a
good
compromise
to
save
on
money
and
sort
of
slowly
move
the
data.
I'm
not.
The
main
purpose
of
this
is
not
to
explain
the
different
kinds
of
elastic,
search,
topologies
or
cluster
architectures
to
you.
B
So
just
a
quick
reminder,
I'm
sure
everyone
knows
how
operator
worked,
but
just
to
remind
ourselves.
Sort
of
the
main
feature
we
are
using
here
is
at
the
extensibility
in
the
kubernetes
api
server
through
custom
resource
definitions
that
allow
us
to
introduce
our
own
types
into
the
created
api.
So,
on
the
right
hand,
side
you
should
see
an
example
of
how
a
elasticsearch
cluster
spec
looks
based
on
our
crd
fight.
So
you
see
what
I
said
earlier
about
different
tiers
of
nodes.
We
call
them
node
sets
here
that
I
have
defined
true
sets
of
nodes.
B
B
Which
has
access
to
the
kubernetes
api
and
watches
as
users
make
changes
to
these
custom
resources
as
they
create
and
spec
out
elasticsearch
clusters,
for
example,
it
responds
to
these
events
and
starts
a
process
that
we
call
reconciliation
where
it
sort
of
compares
what
the
user
has
specified.
I
want
to
have
a
cluster
with
these
and
these
nodes
and
tries
to
compare
what
it
sees
in
the
kubernetes
cluster
at
this
time
and
try
to
try
to
work
towards
that
desired
state.
The
user
has
expressed,
so
it's
maybe
a
little
bit
abstract.
B
B
B
We
need
to
take
special
care
when
we
enact
these
configuration
changes
so
consider,
for
example,
a
scale
down
you
maybe
have
overprovisioned
your
cluster
or
you
you're
migrating
away
from
one
topology
to
another,
so
you're
scaling
down
one
type
of
nodes
and
scaling
up
another
type
of
nodes.
So
we
take
extra
care
that
we
migrated
data
away
from
a
node
before
we
decommission
it
and
that's
not
to
say
that
elasticsearch
doesn't
have
its
own
recovery
mechanisms
to
deal
with
failures,
but
it's
rather
that
this
is
more.
B
This
is
a
planned
configuration
change,
so
we
want
to
have
a
smooth
transition
and
we
don't
want
to
rely
on
the
failure
or
failover
mechanism
in
elasticsearch
and
similarly
for
rolling
upgrades.
So
rolling
upgrades
is
when
we
sort
of
apply
a
new
configuration
to
all
the
nodes
in
the
cluster,
but
we
do
this
one
node.
At
a
time
again,
we
interact
with
elasticsearch
here
and
basically
tell
it
if
you
will
hold
on
a
second
we're
going
to
take
down
this
node,
no
need
to
panic,
no
need
to
recover
the
data.
B
B
Now
I
showed
this
very
simple
manifest
earlier
that
we
that
you
can
use
to
spec
out
your
cluster
for
advanced
users.
We
also
give
a
lot
of
power
by
exposing
the
pod
template,
which
the
state
will
set.
The
underlying
stateful
set
uses
directly
through
our
custom
resource
definition.
So
this
allows
you
to,
for
example,
add
additional
metadata
to
elasticsearch
nodes,
to
use,
affinity,
node
or
part
infinity
or
dfinity,
or
to
tweak
the
jvm.
So
elasticsearch
is
a
jvm
based
application
and
you
can
sort
of
tweak
it
here
with
environment
variables
like
in
this
example,.
B
Coming
back
to
this
idea
that
we're
using
stateful
sets
under
the
hood
to
orchestrate
the
different
tiers
of
nodes
we
have
in
elasticsearch
cluster,
but
not
only
means
that
every
pod
has
a
stable
network
identity.
It
also
means
that
it
has
a
stable
association
with
a
persistent
volume
and
makes
a
lot
of
sense.
Of
course,
we're
talking
about
stateful
application
after
all,
but
we
need
to
give
users
the
ability
to
to
have
an
influence
on
how
these
volumes
are
created.
B
So
this
is
why
the
exposing
in
the
manifest
as
well
the
volume
claim
template
where
you
can
tweak,
for
example,
how
big
the
volume
should
be,
in
this
case,
for
example,
100,
gigabytes
and,
most
importantly,
which
storage
class
should
be
used
to
create
it,
and
that
has,
of
course,
a
lot
of
impact
on
the
performance
of
that
volume,
and
you
need
to
sort
of
make
an
educated
decision
based
on
your
use
case.
What
kind
of
storage
class
you
use.
B
B
B
We
just
released
version
1.3
of
of
elastic
cloud
on
kubernetes,
which
is
going
to
be
the
first
release,
which
is
going
to
be
a
certified
operator,
and
it
has
a
new
feature
to
allow
volume
expansion
which
I'm
going
to
demo,
and
we
also
have
for
people
who
are
invested
in
the
helm
universe.
We
also
offer
the
operator
as
a
health
chart
now
and
we
have
fixed
some
issues
around
ipv6.
B
Sounds
good,
so
I
have
a
set
up:
a
deaf
environment
here,
an
openshift
deaf
environment
and
there's
currently
no
operator
installed.
So
I
can
go
now
to
operator
hub
and
just
search
for
elastic,
and
you
see
the
elastic
operator
here
in
a
few.
I
we
hope
very
soon.
You
will
see
the
certified
operator
there
as
well.
I'm
opting
to
install
this
in
all
namespaces
and
in
a
few
moments
we
should
see
the
operator
pop
up.
In
this
view,.
B
Yeah
we
need
some
elevator
music.
There.
I've
taken
the
liberty
to
create
a
project
ahead
of
time
here
it's
called
elastic
monitoring
because
we're
focusing
on
the
observability
use
case.
So
we
see
what
I
mentioned
earlier
about
custom
resource
definitions,
so
each
of
them
is
an
api
extension
basically
is
listed
here
as
provided
apis,
and
we
can
now
go
ahead
and
maybe
start
creating
an
elastic
search
cluster.
B
If
you
have
this
kind
of
mixed
role,
setup
and
then
the
other
thing
we
also
covered
in
the
presentation
earlier
is
I'm
specking
out
a
volume
claim
template
here
for
50
gigs
and
the
last
setting
at
the
bottom
is
just
because
I
haven't
tweaked
the
kernel
on
this
dev
environment.
So
I'm
turning
off
some
memory.
B
Mapping
feature
in
elasticsearch
which,
on
production
environments,
gives
you
extra
performance,
but
we
don't
need
that
for
the
demo,
so
I'm
hitting
create,
and
what
we
can
see
now
is
that
it's
the
operator
kicks
into
live
and
starts
deploying
this,
and
we
can
actually
use
the
openshift
console
to
see
the
stateful
set.
As
I
said,
we
have
just
one
set
of
nodes
uniform
at
this
point,
prime
back,
and
we
see
the
pots
coming
up
now.
B
B
B
B
We
can
check
if
kibana
is
up.
So
kibana,
as
I
mentioned,
is
a
is
basically
a
status
application,
so
we're
just
using
a
deployment
here
to
to
roll
it
out
into
the
kubernetes
cluster.
You
click
through.
To
that
we
see
the
keyboard
part
is
up
and
running.
We
can
also
monitor
the
health
of
these
applications
that
we
just
have
deployed
display
using
the
standard
command
line.
Tooling,
you
can
use
abbreviations,
you
don't
have
to
spell
out
elasticsearch
like
evan,
I'm
using
the
abbreviation
here,
and
we
see
that
both
reporting
green
health.
B
So
let
me
go
now
to
my
to
the
domain
I'm
using
for
this.
Actually,
this
doesn't
sound
right,
but
yeah,
that's
more
like
it,
I'm
seeing
a
login
window
now.
So
how
do
we
log
in
there's
a
built-in
user
called
elastic
that
I'm
going
to
use
and
what
we're
doing
is
we're
exposing
the
password
for
this
user
through
a
kubernetes
secret?
B
Do
it,
and
actually
there's
a
new
line
in
that,
so
we
need
to
use
some
some
built-in
shell
functions
to
trim
that
off
and
I'm
going
to
macos
there's
a
function
to
copy
stuff
from
the
command
line
into
your
paste
board.
I'm
using
that
as
well,
then
that
should
give
me
the
password
for
production
environments.
What
you're
probably
going
to
do
is
not
do
that
all
the
time,
but
instead
configure
summer
or
some
form
of
single
sign-on
instead,
but
for
the
demo.
I
think
that's
maybe
too
much
for
now.
B
So
what
we
see
now
is
kibana
and
I
said
we're
going
to
look
at
observability
a
little
bit
today
during
this
demo,
and
we
see
there's
nothing
there,
there's
no
no
data
in
there.
So
how
do
we
get
data
in?
Do
you
remember
what
I
said
earlier
about
the
elastic
stack
then
beats
is
the
way
to
go
to
ship
data
into
elasticsearch.
B
What
I,
what
is
a
good
starting
point,
is
our
documentation,
page
for
elastic
cloud
and
kubernetes.
It's
on
the
website,
slash
guide,
and
then
you
just
click
through
to
elastic
button
kubernetes
and
there
we
have
a
section
for
each
individual
application
that
we
support
and
as
we're
interested
in
beats.
Now
there
is
in
the
beats
chapter.
There
is
a
subsection
with
configuration
examples
and
that's
a
good
starting
point,
because
these
bits
configurations,
it's
usually
a
lot
of
yammer.
B
So
this
is
a
the
third
custom
resource,
I'm
introducing
that
we
had
elasticsearch
in
keyboard.
This
is
beats
same
principle,
a
name
namespace
a
version.
The
type
is
metricbeat
because
we
want
to
get
the
metrics
from
the
elasticsearch
cluster
and
then
again,
this
elasticsearch
ref
element
that
we've
seen
before
that
automatically
sets
up
the
connection
to
elasticsearch
and
I'll,
be
using
attribute
configuration
to
extract
elasticsearch,
specific
metrics.
B
In
order
to
have
these
labels
on,
I,
I
also
sorry
scrolling
widely
through
that
document.
I
also
applied
a
configuration
change
to
elasticsearch
itself
to
add
this
metadata
to
the
port
number.
So
this
is
the
cluster
from
before.
All
I
did
was
adding
a
little
bit
of
metadata
here
so
that
metric
can
target
this
specific
cluster,
and
this
is
a
good
opportunity
to
take
a
look
at
how
we
roll
our
changes
in
elasticsearch
clusters.
So
you
see
it's
terminating
the
second
node,
because
I've
been
talking
so
long.
B
It's
already
updated
the
elasticsearch
es
default,
2
node.
So
it's
doing
one
node
at
a
time
terminating
it
waiting
for
30
seconds
to
drain
connections,
to
the
node
rolling
out
the
change
booting
it
up
and
re-creating
the
pod
and
then
waiting
for
the
cluster
to
be
healthy
and
then
continues
with
the
next
now
and
so
in
a
very
safe
way.
It's
rolling
out
this
configuration
change
across
the
whole
cluster.
It
takes
a
little
while,
but
it
makes
sure
that
sort
of
we
don't
lose
availability
during
that
process.
B
I'm
not
going
to
sit
here
and
watch
how
how
this
is
running
out,
we're
almost
done
anyway.
Instead,
I
think
I
want
to
roll
out
two
more
things
in
that
cluster
and,
let's
I
don't
wanna,
I
don't
want
to
only
monitor
my
own
elasticsearch
cluster.
I
also
want
to
monitor
kubernetes
itself,
so
I'm
going
to
roll
out
a
daemon
set
for
metric
feed
that
allows
us
to
monitor
kubernetes
and
filebeat
to
extract
logs
from
all
running
containers.
B
B
And
then
I'm
explaining
a
little
bit
what
they
do
while
we
wait
for
this
to
be
rolled
out,
so,
let's
start
with
metric
beat.
So
this
is
by
now
familiar
the
custom
resource
for
beats
type
magic
beat
elasticsearch.
We've
discussed
this.
The
new
thing
here
is
the
kibana
ref,
which
allows
your
instructor
the
operator
to
automatically
connect
this
magic
bit
instance
also
with
kibana,
so
that
metrobeat
can
install
some
dashboards
into
kibana
and
what
this
yammer
manifest
is
a
slightly
modified
version
from
what
we've
done.
B
So
my
colleague
michael,
is
working
on
a
blog
post,
actually
for
the
openshift
blog,
which
will
have
the
four
manifests
for
you
to
download
very
soon
and
what
this
does
it
targets
specifically
openshift's
control
plane.
So
we
have
done
a
few
tweaks
here
to
to
account
for
the
openshift
namespace
structure,
for
example,
to
extract
metrics
from
the
controller
manager
from
the
scheduler
from
core
dns
and
so
forth.
B
We're
deploying
this
as
a
daemon
set.
So
in
that
custom
resource
you
can
choose
how
to
deploy
metric
beat
you
can
either
deploy
it
as
a
daemon
set
or
as
a
deployment.
In
this
case,
we
want
to
have
this
as
a
demon
set,
which
you
can
see
here
so
and
similarly,
five
bit
is
basically
the
same
idea
with
we've
seen
it
now
a
couple
of
times.
B
Use
a
different
type
here:
it's
firebeat,
not
metric,
beat
but
otherwise
very
similar,
using
elasticsearch
to
automate
the
setup
of
the
connection
and
then
we're
using
a
feature
in
beats.
That's
called
autodiscover,
which
is
for
kubernetes
environments
where
ports
come
and
go
so
that
it
automatically
picks
up
the
logs
from
these
containers
as
they
are
created
or
stops
picking
them
up
once
they
are
deleted
and
again
it's
we're
also
deploying
this
as
a
demon
set.
I
think
that's
all
you
need
to
know
for
now.
Let's
take
a
look
at
the
openshift
console.
B
B
B
For
the
elasticsearch
cluster
that
we've
deployed
the
individual
nodes
and
so
on
and
finally
the
last
bit
we
deployed
metric
beat
to
monitor
kubernetes
itself
and
it
rolled
out
also
a
few
dashboards
that
we
should
be
able
to
see
now,
and
indeed
we
see
six
kubernetes
nodes,
which
is
accurate
to
the
number
of
deployments.
We
see
data
streaming
in
slowly,
just
deploy
that
and
get
stats
about.
Cpu
usage
memory
usage
network
and
we
can
also
look
at
a
specific
dashboard
for
the
equinoxes
controller
manager.
B
You
can
get
metrics
for
the
work,
queue
and
cpu
again
now,
one
last
thing
so
we've
seen
just
to
summarize
what
we've
done.
We've
deployed
metrobeat
to
monitor,
kubernetes
and
the
hosts
in
this
cluster,
like
when
it's
control,
plane
and
hosts
in
this
clusters,
we
deployed
5b
to
harvest
all
logs
from
all
running
containers,
and
I
deployed
stack
monitoring
to
get
a
richer
view
for
a
specific
application.
In
this
case,
elastic
search
itself.
B
And
we
we've
seen
how
a
rolling
upgrade
happened
when
I
added
additional
metadata
for
the
scraping
of
the
matrix
now
one
thing.
One
last
thing
I
want
to
show
you
is
a
the
new
feature
we
added
in
version
1.3,
which
is
inline
or
dynamic
volume
expansion,
if
you
will
so
imagine,
we've
deployed
this
cluster
we're
very
happy
with
this
initial
setup,
but
we
realize
we've
underprovisioned
these
nodes
slightly
with
only
50
gigs
of
storage
space,
and
I
want
to
fix
that.
How
would
you
go
about
that?
B
Well,
if
you
just
are
using
committed
stateful
sets,
you
would
have
to
create
a
new
stateful
set,
because
the
stateful
set
and
its
specification
of
the
persistent
volume
claim
are
immutable.
So
you
cannot
change
the
capacity
once
you've
provisioned
it,
but
we've
added
a
feature
to
work
around
this
until
well.
B
So
what
this
does
is
it
basically
works
around
this
limitation
in
stateful
sets
it's
it's
going
to
directly
edit
the
persistent
volume
claim
and
then
recreate
the
stateful
set
on
on
top
of
that
to
re-adopt
these
pots
that
have
now
been
changed.
You
see
the
events
flowing
in
that
are
already
saying
that
the
volume
expansion
succeeded
here
for
this
persistent
volume
claim.
So
if
you
go
back
to
our
stack
monitoring
view,
we
should
see
that
elastic
search
picks
up
this
volume
expansion
without
the
need
of
a
restart.
B
B
B
That's
the
the
second
way
of
doing
so.
This
here
is
showing
how
to
use
an
init
container.
Basically,
you
run
a
little
shell
script.
That
runs
the
installer,
and
the
alternative
way
is
to
use
a
custom
image.
We
have
a
simple
example
here
as
well
how
it's
like
a
very
simple,
two-line,
docker
image,
based
on
the
official
images
to
install
it,
which
is
probably
recommended
for
more
production,
ready.
A
So
that
makes
it
easy,
hopefully
for
everybody
here
and
we'll
we'll
add
that
link
to
the
page
into
the
the
video
so
that
you
can
find
this
later.
I
had
a
question
because
I
was
reading
through
the
what
was
in
the
latest
release
of
of
elastic
and
specifically
in
kibana
is,
is
kibana
lens
part
of
the
operator,
or
is
that
a
plug-in
or
or
can
you
tell
us
a
little
bit
about
that
because
that
looked
like
really
cool
visualizations
that
got
added
into
the
latest
release.
B
B
So
if
I
create
a
new
visualization
here,
I
click
go
to
lan.
So
it's
already
included
in
the
package-
and
I
can
I
don't
know,
start
playing
around
with
this,
for
example,
to
to
drag
and
drop
some
fields
on
the
left
hand
side
to
create
a
graph
here.
In
this
case,
it's
now
showing
me
the
count
of
records
for
each
different
hostname.
It's
not
the
most
imaginative
use
of
it,
but
you
can.
You
can
come
up,
of
course,
with
your
own
uses,
yeah.
A
B
One
I
mean
in
the
in
the
latest
seven
or
ten
release.
I
think
one
of
the
more
interesting
features
is
sort
of
a
formalization
of
the
concept
of
data
tears.
I
think
I
spoke
about
this
very
briefly
in
the
presentation
so
that
you
have
these
hot,
warm,
cold
use
cases
where
time
series
data
is
moved
to
cheaper
hardware
over
time
and
the
support
for
this
has
been
formalized
in
the
seven
or
ten
release
and
even
extended
in
in
such
a
way
that
you
can
back.
B
So
that
gives
you
another
very
cost
effective
way
of
organizing
of
building
these
multi-tier
architectures
with
elasticsearch
clusters,
where
you
move
your
data
to
cheaper
and
cheaper
data
tiers,
as
it
becomes
less
relevant
to
you
usually
for
log
data
you're
only
interested
into
last
week's
logs
right.
So
it's
then
after
a
week,
then
maybe
you
keep
it
around
for
the
occasional
root
cause
analysis,
and
then
you
know
after
another
week
it's
typically
maybe
you're
only
keeping
it
around
for
regulatory
or
audit
purposes,
and
you
rarely
ever
look
at
it.
A
So
that
that
actually
is
like
one
of
the
the
wonderful
use
cases
for
sort
of
hybrid
cloud
and
hybrid
storage,
I
mean
pick
your
lowest
common
denominator
for
cost
and
and
store
your
stuff
where
it
should
be.
So
I
think
that's
one
of
the
sweet
spots
for
for
cloud
computing
and
taking
advantage
of
that's
a
great
thing.
A
So
I
was
wondering
too,
since
this
is
the
community
side
of
open
shift.
Tell
us
a
little
bit
about
this
is
it's.
This
operator
is
available
on
operatorhub.io,
which
is
you
know,
the
the
community
side
as
well
as
well
as
you've
got
a
certified
one.
What
are
the
differences
between
the
community
release
of
elastic
and
this
operator
and
the
the
the
product
side?
Is
there
anything
missing
between
the
two
of
them
or
how
are
they
differentiated?
B
So
the
community,
so
there
is
how
to
how
to
explain
that,
so
the
community
operator
is
basically
identical
to
the
certified
operator
and
both
allow
you
to
run
in
a
free
to
use
basic
license,
which
is
what
we
we've
seen
today
and
both
the
community
as
well
as
the
certified
operator
or
the
other
download
options
we
have.
If
you
download
it
from
our
website
or
install
it
via
helm,
it
doesn't
matter
both
all
of
these
versions
of
the
operator.
B
B
So,
no
matter
where
you
start,
there's
always
a
way
to
to
sort
of
use
these
commercial
features,
if
you
need
them
and
to
upgrade
and
install
a
license
into
that,
so
there's
no,
no,
no
strong
difference
and
you're
not
locked
into
one
or
the
other.
If
you,
if
you
start
with
the
community
operator
or
any
other
option
of
downloading
it,
that
makes
sense
that.
A
B
B
B
B
Eventually
we
settled
on
controller
runtime
and
q
builder.
Initially,
even
though
we
have
now
replaced
parts
of
what
couped
automates
away
with
sort
of
manual
things
we
do,
and
I
think
it's
really
I
mean
my
my
colleague
sebastian
has
given
a
quite
good
talk
at
the.
I
think,
the
last
year's
kubecon
about
the
pitfalls
of
writing
your
own
operator,
which
summarizes
our
experience
and
sort
of
our
journey
to
understanding
how
this
works.
I
mean
just
to
give
a
few
examples.
I
think
one
thing
we
needed.
B
We
realized
during
that
process
is
the
way
you
interact
with
the
kubernetes.
Api
is
usually
through
cached
clients.
So
there
is
no
direct.
You
know
no
direct
request
to
the
kubernetes
api
server,
and
that,
of
course,
is
a
measure
they've
taken
in
order
to
reduce
load
on
the
actual
api
server.
So,
instead,
you
have
like
cache
locally
in
your
application
and
that
cache
is
synchronized
from
the
api
server.
B
I
think
by
now
we
are
sort
of
aware
of
these
pitfalls,
but
initially,
of
course
that
was
sort
of
something
to
work
around
and,
of
course,
also
things
like
designing
your
custom
resource
definition.
You
know
we
went
through
multiple
iterations
of
of
trying
to
abstract
away
many
many
things
and
giving
the
user
sort
of
a
very
high
level
toggle.
A
I'm
wondering
it's
sort
of
in
a
closing
thing
because
me
I
I'm
totally
focused
on
helping
people
build
their
operators
so
and
whether
it's
for
elastic
or
tremolo
securities,
open
unison,
but
really
hearing
people's
feedback
on
on
the
operator,
the
operator
framework
and
things.
So
thank
you
for
that.
I'm
wondering
if
there's
anything
coming
in
the
elastic
road
map,
new
feature
or
functionality
that
you
we
should
keep
an
eye
out
for
in
the
upcoming
releases
or
something.
What
are
you
working
on
now?
That's
gonna
make
it
even
more.
B
So
I
I
can't
speak
for
sort
of
the
overall
elastic.
I
know
what
we
are
working
on
for
the
operator.
That's
maybe
something
I
can
talk
about
a
little
bit.
So,
of
course,
we
are
trying
to
bring
more
stack
applications
onto
the
operator,
so
there
is
a
new
thing
coming
out,
which
is
called
the
elastic
agent,
which
is
a
way
of
bundling
together.
B
These
different
beats
into
one
binary.
So,
instead
of
what
is
what
you
saw
during
the
demo
that
I
had
to
deploy
metrobeat
separately
from
filebeat-
and
there
are
other
beats
as
well
so
in
the
future,
elastic
agent
will
allow
you
just
deploy
one
binary
and
then
the
different
sort
of
harvesting
capabilities.
It's
just
configuration
of
the
agent.
So
that's
something
we're
looking
into
supporting.
B
Eventually,
we
also
looking
into
sort
of
some
form
of
auto
scaling.
Capabilities
for
the
operator
and
elastic
cloud
on
kubernetes
is
also
a
sort
of
you
know:
a
referenced
elastic
cloud
enterprise
as
the
on-premise
product,
which
has
a
ui
which
has
apis
in
sort
of
in
the
far
future.
We
want
to
sort
of
close
the
gap
here
between
these
two
products
and
give
you
a
similar
experience
as
well
with
a
ui
maybe
and
some
ui
apis.
A
So
we
did
get
one
more
question
from
the
live
stream.
This
is
how
would
I
handle
selection
of
again
specific
nodes
or
in
more
detail
to
deploy
elastic
search
operator
on
a
dedicated
infranodes?
Is
it
preferred
to
configure
the
tolerations
for
taints
on
the
deployment
config
of
elk,
or
do
it
on
the
operator
config
itself?
B
So
I'm
I'm
yeah.
I
think
I'm
reading
this
as
a
question
how
to
so
the
operator
itself,
of
course.
So
if
you
install
it
via
operator
hub,
it's
all
managed
by
the
operator
lifecycle
manager,
so
the
namespace
it
lands
into
is
sort
of
predetermined.
I
think
that's
not
the
question.
I
think
the
person
is
asking
about
how
to
influence
where
the
elasticsearch
nodes
land
on
and
so
there
and
there
you
can.
You
can
use
node
selectors.
B
You
can
use
any
feature
that
sort
of
kubernetes
offers
you
to
target
that,
and
you
would
do
that
as
I
I
think
I
showed
this
briefly.
I
don't
know
about
the
slide
still
up
through
the
flip
template.
I'm
just
going
back
here,
for
example
for
node
affinity
or
you
can
use
a
node
selector,
so
everything
that
kubernetes
offers
you
to
target
a
specific
node
or
exclude
nodes.
A
B
A
I'm
now,
I'm
really
to
have
to
go
play
with
the
cabana
lens,
because
now
you've
made
it
dead
easy,
and
I
have
no
excuse
to
not
to
not
make
beautiful
visuals,
even
though
you
only
showed
us
the
bar.
I
saw
some
demos
earlier
earlier
with,
like
just
beautiful
mapping
and
also
interesting,
really
interesting
stuff,
so
there's
there's
a
whole
whole
world
of
visualization
that
you've
opened
up
to
and
made
much
easier
for
folks.
A
So
I
totally
appreciate
that
and
we'll
have
to
work
out
with
the
open
data
hub
team
too
them
getting
some
nice
visualizations
added
in
which
I've
seen
a
few.
But
this
I
think
this
really
is
going
to
expand
upon
all
this
and
you've
made
it
dead,
easy
for
people
to
deploy
it
now
on
openshift
and
elsewhere
on
kubernetes.
So
this
is
kudos
to
you
and
the
whole
team
over
at
elastic.
Thank
you
so
much
for
taking
the
time
today.