►
From YouTube: CNF WG Meeting 2021-06-07
Description
CNF WG Meeting 2021-06-07
A
B
B
A
A
A
A
I
think
on
the
orchestra,
what
was
presented
it'd
be
interesting
to
hear
some
of
the
specific
and
maybe
break
down
some
of
the
sections
and
have
it
as
smaller
topics
there
may
be
or
like
what
are
the
maybe
the
use
cases.
What
are
use
cases
that
they've
been
targeting.
A
Hello
folks
we're
going
to
get
started
at
five
afters
couple
of
minutes
and
the
meeting
notes
are
in
the
zoom
chat.
You
can
add
your
name
and
any
agenda.
A
A
A
A
A
A
A
That
one's
good
enough
well
good
enough.
I
think
that
one
could
would
be
good
as
a
discussion
item
on
the
discussion
board.
So
for
those
that
don't
know
or
haven't
seen
on
github,
maybe
we
have
a
discussion
area
that
we've
been
using
and
I
think
in
that
performance
related
one.
We
could
have
some
stuff
there
as
well.
E
A
quick
technical
question:
if
is
there
a
way
to
share
google
documents
with
everybody
on
the
list?
Is
there
like
a
google
group
list
or
something
for
for
all
of
us
or.
C
E
A
Thanks,
if
you
haven't
seen
it
tell,
I
know,
there's
a
few
companies
that,
even
if
you
share
something
and
make
it
anybody
with
the
link,
can
see
it.
There
are
a
few
that
don't
allow
it.
I
think
verizon
might
be
one,
so
you
may
get
requests
from
those
folks
saying.
Can
you
please
share
and
you'll.
E
E
That's
true,
I
think
you
have
to
be
careful
when
you
click
share
and
on
google
drive,
you
can't
check
that
it's
not
just
for
your
company
and
that
it
is
global
and
if
you're
not
allowed
to
make
it
global
well,
you
can
always
use
your
your
non-work
gmail
account.
If
you
have
one.
A
All
right,
so
any
other
topics
before
we
jump
into.
We
got
some
prs
that
we
wanted
to
look
at
frederick
messaged
me,
so
he
may
come
in
and
talk
about
this
security
topic
here
in
a
bit
if
you
can
get
on,
but
are
there
any
other
topics?
That
folks
would
like
to
add.
A
A
A
staple
in
the
pull
request:
this
is
a
use
case
that
simon
from
matrix
was
had
submitted,
and
I
think
he
worked
on
that
with
you
oliver
I
I
not
saying
oh
there's,
simon,
hey
simon
it'd,
be
nice
to
get
this
one
through.
I
think
the
main
questions
or
comments
about
this
right
now
were
about
making
some
of
the
use
case,
statements
to
be
either
more
general
or
to
explicitly
say
when
memory
is
being
used.
It's
it
was
one,
I
guess
one
path
versus
the
path.
A
A
Hello,
all
right,
so
do
you
have
a
a
a
real
short
simon
overview,
for
you
can
say
what
this
is
for
folks,
who
may
not
have
seen
it
and
they
can
come
check
it
out.
F
Yeah,
this
is
a
use
case,
talking
about
how
a
clarinative
function
needs
to
maintain
state
and
different
types
of
state
that
it
might
mean
to
need
to
maintain.
The
specific
use
case
is
about
the
5g
chf
scenario,
where
subscribers
are
interacting
with
a
charging
system.
F
That's,
I
guess,
that's
the
short
short
short
version
and
the
summary
is
basically
that
cnf
needs.
You
know
when
it's
maintaining
state
should
continue
to
follow
cloud
native
principles
and
try
to
be
loosely
coupled
with
the
hardware
on
which
it's
running.
G
I
have
a
question
in
a
current
practice.
What
is
typically
used
for
as
a
persistent
storage
or
persistent
volume
to
persist
that
state.
F
F
Or
that
in
like
an
eks
kind
of
environment,
that's
the
the
persisted
to
disk
storage
and
it's
used
for
things
like
checkpoints
and
backups.
The
actual
data
is
all
stored
in
memory.
G
But
this
this
use
case
is
looking
at
the
perspective
of
of
persistent
storage,
really
the
state
statefulness.
F
It's
looking
it's
well,
I
guess
that's
where
that's
where
the
confusion
comes
from,
because
when
we
talk
about
state
we're
talking
about
state
that
is
held
in
memory
for
low
latency
reasons,.
F
So,
and
in
the
implementation
of
this,
as
I
said,
we,
we
write
to
shared
storage
as
a
fallback,
dr
kind
of
scenario,
and
for
like
offline
synchronization,
whereas
all
online
stereo
synchronization
and
the
actual
session
state
and
long
held
state
like
balances
and
things
like
that
are
held
in
memory
on
all
systems.
G
Then
this
means
like
making
the
such
a
network
function
stateful.
When
we
look
at
the
fast
in
memory
storage,
it
means
that
at
the
points
of
either
node
draining
or
shifting
rescheduling
the
the
pods
or
they
would
need
to
act
as
a
stateful
set
or
if
they
are
not
as
a
stateful
set,
they
would
need
to
have
a
mechanism
to
to
to
consume
or
to
empty
this
or
to
migrate.
This
information,
that
is
in
memory
to
another
node
yeah
or
flash
it
to
the
to
the
persistent
storage
and
then
start
a
new.
F
Yeah,
so
they
are
managed
as
a
kubernetes
stateful
set,
and
there
is
like
an
operator
that
sits
on
top
of
it
that
manages
so.
In
addition
to
like
the
standard,
kubernetes
clustering,
we
have
our
own
clustering
technology,
which
we
use
to
do
like
online
synchronization.
So
whenever
you
interact
with
one
particular
node,
that
interaction
is
synchronized
with
all
of
the
nodes
that
are
in
that
particular
cluster.
G
Yeah
it
gives
gives
the
insight
now
trying
to,
but
I
need
to
read
that
completely.
I
read
it
very
quickly
and
it
was
maybe
two
weeks
ago.
G
So
I
need
to
to
go
thoroughly
because
now
from
that
point,
I'm
just
thinking
how
to
generalize
it
for
the
use
case,
because
I
would
normally
say
from
the
infrastructure
perspective,
you
got
no
control
over
the
nodes.
You
can
use
the
node
that
you
are
allocated
to
as
a
workload
at
the
given
point
in
time
and
you
will
be
moved
out
of
that
node
via
kubernetes
mechanisms,
which
is
which
is.
F
Still
true
in
stateful,
and
especially
with
these
kind
of
high
performance,
stateful
scenarios
or
any
stateless
scenarios,
in
fact
the
high
performance
we
for
the
implementation,
we
actually
taint
certain
nodes
to
makes
them
exclusive
to
our
use,
and
if
that
workload
cannot
run
on
those
nodes,
then
other
nodes
would
need
to
be
brought
up
and
tainted
so
that
that
workload
can
be
moved
across,
but
that
would
have
to
be
all
controlled.
F
F
Kubernetes
at
the
end,
and
it's
the
end
of
the
day,
this
is
basically
what
it
is.
It's
a
it's
an
on.
You
know
an
in-memory
database.
That's
you
know.
You've
got
high
high
performance,
low
latency,
so
yeah
it
has
that
same
so
so
I
guess
this
could
be
written
from
the
perspective
of.
If
you
were
to
stand
up,
you
know
an
in-memory
database
in
kubernetes.
What
challenges
would
you
have
to
think
about,
and
these
are
the
same
challenges
that
I've
tried
to
document.
G
We
have
our
opinionated
setup,
which
is
relying
on
external
all-flash,
nvme
storage,
which
is
behaving
very
close
to
the
in
terms
of
performance
to
ram,
but
that's
not
probably
something
for
a
best
practice.
G
It
is,
we
use
the
flash
arrays
that
are
sitting
in
the
same
wreck
or
in
the
rex,
where
we
have
the
nodes
and
they
are
all
connected
with
with
100
gig
iscsi
and
soon
to
be
nvme
over
fiber
to
that
storage.
But
it's
not
exclusively
storage
for
one
cluster.
It's
it's
shared
between
number
of
clusters,
though.
It's
a
state-of-the-art,
highly
performance
storage
system,
so.
E
So
this
is
interesting
just
to
add
a
point.
I
I
said
last
meeting
that
I'm
working
on
a
on
a
document
about
the
use
of
kubernetes
operators
with
with
our
use
cases,
it's
become
quite
long
at
this
point.
It's
five
pages
long.
Sorry,
it'll
take
some
time.
It's
a
big
discussion,
but
one
of
the
things
I'm
really
examining
is
operators
are
usu
are
useful
in
cases
where
you
need
to
manage
state
a
state.
E
That's
not
non-ephemeral
right,
because
one
of
the
problems
or
challenges,
I
would
say
with
with
the
using
clouds
generally,
is
that
you
think
of
your
resources
as
being
ephemeral.
That
is
kubernetes
can
destroy
them
and
create
them,
and
supposedly
your
application
can
continue
working.
You
know
as
long
as
they're
recreated,
but
things
like
databases-
I
mean,
if
you,
if
you
look
at
the
use
cases
of
kubernetes
operators,
90
of
the
kubernetes
operators
are
database
cluster
managers,
and
it
has
to
do
exactly
with
that.
E
You
need
you
need
something
external
to
to
the
resource
itself
in
order
to
manage
that
resource
and
make
sure
that
the
cluster
is
managed
according
to
its
rules
right,
because
each
each
state
has
its
own
specific
rules
so
specific
cluster
management
rules,
and
that
that's
knowledge
that
kubernetes
doesn't
naturally
have
that's
something
that
you
need
to
encode,
for
example,
by
using
an
operator.
H
Yes,
something
that
would
be
interesting
there
as
well,
is
so
many
people
when
they
work
with
operators,
they
they
they're,
taking
the
assumption
that
they'll
always
have
a
clean
shutdown,
but
we
know
this
is
not
all
we
know.
This
is
not
true
and
in
terms
of
operators,
it
would
also
be
good
to
tie
in
what
how
an
operator
can
help
you,
when
you
have
something
bad
happening
in
your
system,
like
you
have
some
state
that
the
state
disappears.
H
E
E
You
know
in
certain
kind
of
cluster
arrangements,
you
have
one
one
node,
that's
a
writer
node
and
the
other
nodes
are
reader
nodes,
say
mongodb,
so
you
have
some
sort
of
election
management
system,
so
these
things
kubernetes
has
no
idea
about
them
right.
This
is
something
that
you
need
to
add
to
the
system
to
make
it
viable.
For
example,
cubevert
for
virtual
machines.
E
Has
you
know
one
of
the
requirements
for
virtual
machines
which
doesn't
exist
for
containers
is
that
they
can
be
frozen
and
they
can
be
migrated,
for
example,
to
another
cluster,
as
is
right
with
all
their
ram
and
memory
and
everything.
So
these
are
future
features
that
keyboard
has,
because
it
considers
virtual
machines
to
be
stateful
in
ways
that
containers
aren't.
G
Maybe
we
also
beside
databases.
We
also
noticed
for
a
telco
applications
in
in,
for
example,
if
you
have
a
user
claim
functions
upf.
So
we
work
with
with
one
of
the
vendors
and
the
challenge
there
is
you
have
a
this
upf
pods
or
containers
that
are
holding
customer
sessions
not
for
charging
purposes,
but
for
maintaining
the
connection,
and
when
this
pod
goes,
these
sessions
would
be
either
interrupted
or
they
need
to
be
migrated.
G
So
they
have
a
operator
that
sits
on
top
of
these
upf
pods
and
kind
of
proactively
replicates
all
the
sessions
or
make
a
cache
on
all
other
nodes,
so
that
at
any
given
point
in
time,
if
that
node
or
pod
fails
the
other
standing
that
gets
selected
to
master
or
leader
or
whatever
would
know
how
to
continue
forwarding
the
packets.
So
it's
also
controlled
by
the
by
the
operators
that
are
custom
made
for
that
purpose.
F
For
as
we're
talking
about
operators,
my
view
is
that
operators
really
shouldn't
be
getting
too
deep
into
just
the
secondary
cluster
management
and-
and
maybe
that's
the
the
wrong
viewpoint.
But
I
my
feeling
is
that
an
operator
really
is
just
there
to
help
kubernetes
understand
the
particular
management
requirements
for
the
pods.
F
I
don't
feel
like
that
is
the
right
place
to
put
all
of
the
like.
The
secondary
cluster
synchronization
logic.
G
G
But
if
cluster
decides
that
the
node,
where
that
specific
type
of
pod
is
running,
is
going
to
be
drained
and
needs
to
go
out
of
the
out
of
the
pool
and
be
replaced
with
another
one,
the
application
needs
to
handle
it
and
it
handles
it
with
the
operator
as
a
mechanism
who
is
aware
of
that
event
could
happen
and
proactively
making
sure
that
the
application
would
continue
working
uninterrupted.
G
F
The
operator
reacts
to
the
event
of
this.
Node
is
going
to
be
drained
and
triggers
something
you
know,
application
specific
logic
that
does
the
migration
of
that.
You
know
upf.
G
I'm
not
100
sure,
but
I
I
think
it
reacts
on
the
mo
on
the
on
the
notion.
My
master
upf
pod
is
getting
kicked
out.
So
I
need
to
re
start
the
mechanism
to
select
one
of
my
remaining
ports
as
a
masters
and
create
a
new
one,
and
if
you
are
a
new
master,
you
need
to
to
be
able
to
pick
up
where
the
the
old
master
was
standing.
Something
like
that
not
hundred
percent
sure
is
it
on
which
signals
it
reacts.
G
But
at
the
end,
this
business
logic
or
this
operational
logic
is
built
into
that
operator
and
it
handles
that
event.
G
But
on
the
application
level
only
doesn't
coordinate
with
the
infrastructure.
Anything.
F
E
F
E
To
point
out
simon,
I
think
one
thing
I'm
trying
to
distinguish
in
my
document
that
I'm
working
on
is
there's
a
big
mess
in
terminology
in
terms
of
operators
and
custom
controllers,
and
things
like
that.
But
I
do
talk
about
something
called
a
pure
operator
which
is
in
the.
E
If
anybody
has
a
background
in
functional
languages,
can
guess
what
I
mean,
but
but
but
these
kind
of
pure
operators
don't
have
side
effects
and
indeed
do
what
you
describe,
which
are
they
basically
take
some
kubernetes
resources,
usually
crds
and
manipulate
other
custom
resources.
So,
for
example,
the
built-in
deployment
controller
is
exactly
that
kind
of
pure
operator
right.
A
deployment
takes
a
deployment
resource
and
turns
it
into
a
replica
set
resource
that
it
then
owns,
and
it
doesn't
have
any
side
effects
other
than
that.
E
But
there
are
a
lot
of
operators
that
are
not
pure
and
and
they
do
work
right
and-
and
I
think
that's
the
kind
of
operators
that
are
sometimes
very
interesting
in
the
cnf
use
case.
Both
are
both
are
interesting.
F
Yeah
yeah
and,
in
actual
fact,
the
operators
that
we,
the
we
have
two
operators
in
our
code
base
and
those
do
have
side
effects.
Although
the
side
effects
are
more
managing
where
we
require
pods
to
start
or
stop
and
and
that's
really
the
limit
of
of
what
we
do,
we
we
use
the
operator
framework
to
you,
know,
bring
workloads
up
and
you
know,
set
configuration
properties
and
those
kind
of
things.
F
So
it's
almost
like
a
pure
operator
where
we're
effectively
just
maintaining
the
stable
set
that
is
then
running
the
workload
we
don't
use
operators
to
actually
interact
with
the
the
sort
of
application
specific
cluster.
The
data
is
all
have
handled
directly
in
the
application
code.
F
You
know
outside
of
kubernetes
effectively
or
is
it
running
obviously
running
within
kubernetes,
but
kubernetes
is
completely
unaware
that
we
have
a
cluster.
A
All
right
so.
A
What
do
we
need?
Well,
I
guess
we
need.
We
need
some
reviews
on
this
one,
but
if
folks
could
take
a
look
and
other
than
this
memory
thing
simon,
it
looks
like
there
hadn't
been
any
other
comments
as
far
as
updating.
So
what
we're
trying
to
do
is
get
this
use
case
in
that's.
A
We
want
to
get
it
merged,
so
if
folks
can
look
at
it
and
give
your
approval
or
request
any
clarifications,
we're
not
trying
to
solve
all
the
things
and
if
there's
no
major
issues,
we
want
to
get
it
in
and
start
iterating
once
it's
there
versus
keeping
it
open.
Yeah.
F
Yeah,
I
will,
I
will
address
the
the
in-memory
as
a
one
type
of
implementation.
I
think
that
was
the
basic
just
yes,
the
comment,
and
so
I'll
change
the
wording
to
to
sort
of
suggest
that
rather
than
saying
this
is
how
you
have
to
do
it,
although
you
know
it's
a
use
case.
F
So
therefore,
a
a
particular
example
of
the
type
of
thing,
as
opposed
to
you
know
trying
not
to
we
tried
to
be
generic,
but
obviously
use
cases
are
specific
to
a
use,
and
this
is
this
is
that
use,
but
I
will
try
to
make
it
even
more
generic.
A
I
don't,
I
don't
think
you
have
to
remove
the
use
of
memory.
I
think
you
could,
as
you're
saying
your
the
use
case
is
tied
into
a
specific
use,
so
you
could,
if
it
clarifies
maybe
before
that
starts
to
say,
we've
chosen
memory
as
our
solution.
Now
we're
going
to
talk
about
that.
There
are
other
solutions
and
then
it
would
be
fine
address
it
if,
if
it
doesn't
make
sense
to
go
too
generic,
because
that
could
get
confusing.
A
Does
anyone
have
anything
else
specific
or
otherwise
you
can
just
go
review
it
and
please
give
feedback
in
the
pr.
A
Itself,
all
right,
and
if
you
look
at,
if
you
click
through,
if
you
all
don't
see
this
already,
you
can
click
through
to
simon's
branch
and
from
there
you
can
actually
see
like
the
images
and
stuff
which.
A
If
you
did
a
full
url,
it
may
work,
but
it's
fine
all
right.
Let's
see
the
next
use
case.
A
Which
we
may
not
have-
let's
see,
I
don't
see
a
sheesh
on
this
call,
but
this
is
a
there's
actually
two
use
cases
and
there's
a
discussion
item
on
at
least
the
synchronization
timing,
which
I
think
was
relevant
for
the
stateful
stuff,
simon
that
you
had
talked
about,
but
there's
a
discussion,
a
discussion,
one
on
this
one
as
well,
where
there's
some
things
here
and
there's
been
some
topics.
I'm
gonna
just
add
that
discussion
here,
but
this
is
actually
adding
two
different
use
cases.
A
So
the
synchronization
and
timing
for
cnfs
and
then
this
one's
about.
How
do
you
have
interfaces
for
cns
that
do
different
types
of
communication.
D
D
Read
than
I
last
did
so,
which
is.
A
Well,
I
think
this
one
is
another
one
where
it's
nice
to
click
through
see
the
use
case
directly,
so
this
go
through
and
and
pull
each
of
these
up,
and
they
have
some
references.
A
I'm
not
going
to
go
through
all
that
and
they're,
not
there,
I'm
not
here,
but
if,
if
folks
can
take
a
look
at
these
trying
to
get
it
through,
I
think
vook.
You
had
one
here
this
onboarding,
I'm
gonna,
pull
that
one
up
and
it
looks
yeah.
We
have
some
time
use
case
and
we
need
more
reviewers
on
this.
G
Yeah
I
can,
I
can
shortly
elaborate
the
background,
so
it's
do.
G
I
I
could
just
walk
through
the
merge
request
or
pull
request
and
then
show
so
it's
a
pretty,
let's
say:
non-technical,
it's
more
process
or
methodology
related
use
case
and
I'm
going
to.
Let
me
just
grab
the
screen.
G
G
Hope
you
can
see
that
now
looks
good,
and
now
I'm
noticing
that
I
didn't.
G
I
didn't
edit
that
anyway,
I
think
we
have
a
bit
of
issue
with
numbering
because,
as
people
are
making
the
use
cases
in
parallel,
they
pick
the
the
next
free
one
and
then,
by
the
time
it's
merged,
then
there
might
be
overlap.
So
I
guess
this
is
why
I
didn't
assign
any
any
numbering
at
this
stage.
G
The
use
case
is
derived
from
the
the
practical
experiences
over
the
last
say,
give
or
take
a
year
where
we
are
seeing
the
new
situation
emerging
for
the
net
for
function,
teams
within
the
the
operator
or
csp
and
their
partners
and
the
vendors.
G
Because
so
far,
if
you
talk
about
physical
network
function,
pnf,
it
was
brought
to
the
the
csp
as
it
is
designed
and
with
a
good
documentation
and
integration
interfaces,
so
didn't
have
any
anything
like
except
the
integration
in
the
wider
environment,
but
in
terms
of
vertical
stacking,
it
was
full
thing.
In
the
vnf
world
we
experienced
that
it
ended
up
mostly
on
application
vendor
bringing
either
own
nfvi
or
nfvi
blueprint,
which
was
stating
the
requirements
and
in
the
in
the
cnf
case.
G
We
have
now
situation
that
they're
in
in
some
csps
like
ours,
but
I
would
say
in
in
most
there
is
a
de
facto
one
platform
being
being
present
and
being
developed
whatever
kind
of
flavor
you
take
with
open
source
or
some
purchase
platform,
but
it's
there,
and
there
is
expectation
that
on
that
platform,
many
of
the
of
the
different
functions
are
running,
and
this
is
now
a
new
situation
for
the
csp
network
function,
teams
and
their
vendors
so
that
they
need
to
do
this
onboarding
on
the
infrastructure,
and
we
saw
a
number
of
challenges
in
in
a
current
practice.
G
First
of
all,
the
cnfs
are
written
in
a
way
that
they
are
suitable
for
this
service
delivery
or
professional
services
departments
of
the
vendors.
So
if
the
customer
like
csp
team
takes
it,
the
documentation
is
very
much
targeting
people
who
are
very
deeply
into
that
topic.
So
on
the
on
the
vendor
side,
and
it's
also
targeting
every
every
vendor.
G
So
far
we
saw
it
has
its
own
sort
of
platform
and
blueprint
they're
more
open
to
integrate
on
the
third
party
platform,
but
all
things
and
all
know
how
is
kind
of
tilted
towards
this
this
blueprint.
So
we
saw
that
that's
one
of
the
one
of
the
elements
that
makes
it
difficult
to
do
the
onboarding.
That
is
really
not
the
custom
integration.
G
The
second
is,
the
requirements
are
not
clear
up
front
with
having
in
mind
third
party
platform,
so
they
are
usually
coming
in
the
portions
and
we
do
a
bit
of
try
trial
and
error
type
of
onboarding,
so
we
get
the
first
set,
then
fulfill
that
and
start
onboarding
and
say
now.
This
is
forgotten.
That
is
forgotten.
So
what
I
am
trying
to
address
with
this
use
case,
I
I
will
not
go
in
the
in
the
more
aspects.
There
are
a
couple
of
more,
but
it
all
revolves
around.
G
Do
you
have
a
like
a
state-of-the-art
package
for
that
of
that
cnf
that
can
be
used
like
any
kind
of
commercial
software
by
the
teams
to
to
onboard
it
on
the
operating
system
or
install
it
somewhere
and
so
on.
So
the
cns
are
not
in
that
state
at
the
moment,
and
this
use
case
is
tackling
the
needs
to
go
with
some,
let's
say
more
streamlined
and
then
more.
G
Say
state-of-the-art
approach
when
delivering
and
packaging
those
those
applications-
and
there
are
a
couple
of
best
practices
for
the
software
distribution
that
could
be
followed
for
cloud
native
software
distribution,
these
kind
of
things,
so
that's
the
the
quintessence
of
it.
G
Maybe
just
one
thing
that
I
didn't
wrote
here
for
a
background
in
a
couple
of
onboarding
cases,
it's
also
very
fun
process
to
do
and
very
insightful
and
learning
process,
but
it's
it
could
be
more,
let's
say
much
more
professionalized,
but
we
say
we
come
with
a
vendor
and
say:
oh,
we
had
in
mind
this
and
this
I
don't
know
we
deploy
with
the
jenkins
and
this
pipeline
and
so
on.
G
And
then
we
do
reverse
engineering
because
we
say
on
our
platform:
we
we
do
something,
that's
more
native
to
that
helm
or
whatever.
So
then
we
are
reverse
engineering,
their
application
coming
to
the
basic
artifacts
and
then
building
up
the
new
packages
so
that
we
can
re
reproducibly,
deploy
it
and
repeat
and
repeat
it
in
the
many
environments.
So
it's
kind
of
I
think
there
is
a
space
for
a
best
practice
discussion
and
maybe
a
broader
consensus.
A
Thanks
fook:
does
anyone
have
any
questions
or
comments?
It's
another
use
case
that
we'd
like
to
get
in
place
and
then
and
specifically
what
book
was
saying,
start
breaking
breaking
down
the
parts
and
looking
for
different
practices
that
we
can
eventually
say.
Here's
good
cloud
native
and
kubernetes
practices,
and
we
want
to
split
those
out
for
those
who
aren't
familiar,
that
one
of
the
end
goals
is
to
make
it
where
you
can
somewhat
all
the
cart
go
in,
and
you
pick
the
different
practices
and
be
able
to
piece
those
together.
E
I
I
guess
one
comment
I
would
make
is
well
it's
it's
a
good
discussion
here.
What
the
challenges
are,
but
some
of
these
challenges
might
be
self-inflicted
if,
if,
if
you
choose
helm
so
that
you
know
the
comment
is
frequently
or
delivered
as
helm
charts-
and
you
know
I
don't
know
how
neutral
that
is
necessarily
right-
there.
There
could
be
other
ways
to
deliver
and
deploy
cnfs.
E
For
example,
you
know
going
back
to
operators.
Sorry
one
way
could.
A
Tell
the
the
idea
here
is
giving
one
example:
that's
fine,
there's,
definitely
multiple
ways
and
I
mean
helm
was
when
it
was
coming
in.
There
were
already
multiple
ways,
so
we're
really
talking
about
how
do
we
help
the
people
that
are
using
helm
and
if,
if
there's
a
other
ways,
then
we
can
also
present
like
letters,
a
use
case
that
could
cover
multiple
paths.
E
G
I
mean
it's.
Definitely
I
think
if
you,
if
you
can
suggest
the
the
edit
on
this
to
make
it
generalized,
it
was
like
one
of
the
the
examples
for
what
we
meet
in
the
practice
and
yeah.
Let's
face
it,
the
helm
is
one
of
the
standards
for
distributing
things,
but
here
what
I
try
to
point
out
is
even
if
they
come
with
the
helm
and
if
you
look
at
the
helm,
best
practices,
they
diverge
very
very
widely.
G
So
if
you
are
used
to
let's
say
using
helm
in
some
way
and
then
you
meet
a
cnf,
that's
packaging,
helm,
and
then
you
see
oops
many
things
that
I
assume
good
helm
package
would
do
this.
These
are
not
covering,
but
there
could
be
many
or
not
many,
but
couple
of
sections
like
if
you
do
helm
charts.
G
These
are
the
recommendations.
These
are
maybe
limits
and
so
on
yeah,
the
better.
D
G
Would
be
go
for
operators,
and
this
would
be
recommendation,
and
so
so
right
kind
of
at
the
end.
It
is
how
do
we
align
cnfs
more
or
how
would
cnfs
align
better
with
the
modern
cloud
native
software
distribution
practices.
D
So,
let's
just
be
clear
that
what
we're
trying
to
do
is
not
just
different,
because
it's
cnfs
it's
different,
because
it's
multiple
applications
on
the
same
platform
that
want
serious
quantities
of
independence
from
each
other.
Now
what
we
could
do
ultimately
from
this
is
we
could
write
a
best
practice
that
says,
if
you
insist
on
using
helm,
then
you
should
do
these
things.
That
would
be
a
perfectly
reasonable
best
practice
to
have,
and
I
think
it's
quite
you
know
a
plausible
thing
to
write.
D
D
We
could
work
through
that
and
we
could
make
a
best
practice
that
says:
if
you're
going
to
use
helm,
you
use
it
in
these
ways.
That's
one
thing
on
the
operator
side
of
things
then,
as
yet
yes
operator
is
definitely
a
good
way
of
running
an
application.
You
can
write
an
operator
specific
to
an
application,
they're,
also
a
terrible
way
of
orchestrating
an
application,
because
you're
writing
an
operator
that
effectively
is
part
of
the
platform,
because
it
is
a
platform
service
that
effectively
says
the
application
is
a
platform
service,
that's
its
purpose.
D
G
H
I
think
something
that
we're
missing
here
as
well
is
is
who's
the
audience
for,
for
some
of
these
documents
as
well.
So
is
the
audience
someone
who
is
new
to
kubernetes
who's
tasked
with
operating
this
stuff
they're.
Looking
at
a
green
field
deployment
they're
looking
at
they're
looking
at
something
that
already
exists,
that
has
helm
charts
already
available.
H
Are
we
or
is
it
the
developer,
who's
trying
to
make
a
decision?
Do
I
go
with
operators?
Do
I
go
with
home
charge
the
mixture
of
both?
H
E
I
I
I
agree
with
everything
said
here.
My
feeling
just
is
that
maybe
this
use
case
can
be
broken
down,
that
the
the
issue
of
having
the
challenges
having
to
do
with
home
deployment
could
be
its
own
use
case.
I
think
it's
I
I
I
like
this
particular
use
case.
I
think
it
just
it
could
be
made
more
generic
than
it
is
right
now,
because
it,
it
just
addresses
a
very
specific
challenge
that
isn't
necessarily
related
to
these
cases
as
a
whole.
It's
just
related.
D
To
it
so
so
a
better
way
of
phrasing
that
is
rather
than
basically
say
this
is
great,
but
it's
not
what
I
want.
I
think
we
would
say
this
is
great,
but
it's
got
a
certain
scope
so
that
we,
you
know,
it's
not
pretending
to
be
the
solution
to
all
problems,
and
it
doesn't
need
rewriting
to
be
the
solution
to
all
problems.
It
just
needs
to
be
the
solution
to
the
problem
it
describes
and
then,
if
you
want
a
more
generic
one,
you
go.
D
You
write
a
more
generic
one,
because
it
seems
unfair
that
you
want
something
that
hasn't
written,
because
what
he's
written
makes
sense.
So
you
won't
let
him
commit
it,
because
it's
not
what
you
you
would
have
written
yourself.
I
think
write
your
own.
You
know
forward.
Progress
is
valuable
here
right.
If
this
is
taking
certain
assumptions
into
account
and
then
moving
forward
from
there,
then
it
should
document
its
assumptions
and
that's
all
it
needs
to
do.
D
G
Maybe
to
to
highlight
actually
this,
I
think
the
confusion
comes
probably
from
pointing
out
some
specific,
very
specific
things
in
the
limitations.
But
if
you
look
at
the
expected
behavior,
if
I
remember
correctly,
I
put
it
in
a
very
generic
way.
Talking
about
the
actor.
So
here
is
like
a
cnf
devops
team
expects
to
deploy
and
configure
the
cnf
application
on
their
own,
preferably
via
automation,
pipelines
and
interaction
with
the
platform
team.
So
this
is
one
expectation.
G
Then
they
require
well-documented
procedures,
tests
and
so
on,
and
so
on.
So
that's
kind
of
very
generic
how
it
would
be,
but
some
I
would
say
if
you
would
say
some
challenges
and
limitations
with
cube
native
approach.
This
is
depicting
more
or
less
status
quo
and
and
the
practice
which
we
are
facing,
and
this
is
why
it's
singled
out
as
its
pattern
that
repeats,
but
we
could
enrich
this
or
modify
this
or
yeah
for
the
sake.
Anything
in
that
one.
G
It's
one
one
view,
and
I
would
be
perfectly
fine
to
have
some
rounds
with
the
comments
or
or
even
suggested,
commits.
G
A
Point
out
helm,
charts
on
the
limitations
for
the
third
paragraph.
The
rest
is
pretty
generic,
so
we're
and-
and
you
specifically
say,
they're
frequently-
it's
not
saying
that
anyone
else
needs
to
do
that.
It's
that
that's.
That
is
the
case
for
applications
deployed
to
kubernetes
or
frequently-
and
maybe
you
could
say
generally
are
delivered.
So
I
think
that's
okay,
back
in
the
expected
behavior
on
the
second
paragraph
last
sentence:
you're,
you
have
this
part
where
you're
saying
typical
for
cloud
native
applications
and
then
helm,
charts,
containers
and
manifest.
A
Those
are
just
examples,
so
I
think
we're
open
to
expanding
on
this
and
we
could
have
more
specific
ones.
But
this
is
already,
I
think,
pretty
general
and
you
could
talk.
You
could
definitely
talk
about
applications
that
are
only
manifest
files
and
we've
seen
those
doing
some
testing
where
there
you
have
manifest
for
deploying
the
containers.
But
you
do
not
have
helm
charts
covering
all
the
different
pieces
and
there
could
be
other
ways
of
doing
that.
G
G
Yeah,
I
could
talk
in
detail
about
some
some
things
like
you
know.
Many
operators
that
that
tal
mentioned
are
also
coming
packaged
or
to
be
installed
via
hem
charts,
and
we
see
that
many
of
them
install
use
a
hem
charge
to
install
crds
and
helm
is
not
good
at
all
in
handling
crds,
so
they
cannot
upgrade
crds
properly.
G
So
then
we
come
to
the
point
to
to
ask
the
vendors
okay
now
yeah,
we
got
it
installed.
How
do
we
want
to
manage
it
at
the
next
step?
And
then
this
is
where
we
get
discussion
going,
so
I
could
even
provide
the
more
more
technical
insights
behind
these
abstract
things.
I
could
expand
the
list
because
indeed
we
are
having,
in
many
cases,
hem
charts
that
install
the
operators
that
install
then
rest
of
the
things.
E
Right
and
there
there's
a
middle
ground
too,
you
can
use
customize
with
a
k,
that's
kind
of
a
helm,
helm
light.
It's
not
used
that
much,
but
I
have
seen
it.
H
Used
so
when
you
say,
don't
don't
add
in
the
crd
creation,
do
you
specifically
mean
the
the
custom
resource
definition
itself
or
the
customers.
G
G
If
you
have
a
big
helm,
chart
that
bundles
cr
crd
definitions
and
deployments
or
whatever
rest
of
it,
then
when
you
want
to
to
change
something
you
do
update,
then
it
will
fail
because
it
cannot
touch
crds
and
then
nothing
else
will
get
get
updated.
F
So
is
that
a
limitation
with
the
kubernetes
of
native
approach,
or
is
that
a
limitation
with
the
helm
tool
itself?
I
mean
it's
a
perspective.
Helm
is
the
best
access
or
de
facto
standard
in
any
way
of
delivering
cns.
So
it's
just
a
limitation
of
helm
not
being
able
to
manage
the
life
cycle
of
a
crd
differently,
which,
which
is
to
be
fair,
because
it's
a
cluster-wide
resource
that
really
shouldn't
change
very
often
yeah.
F
The
problem
is,
when
you
decide
to
change
the
crd,
it's
very
hard
to
you
know
to
to
manage
that.
G
You
have
all
sorts
of
these
of
these
issues
just.
D
Which
is
separate
yeah
if,
if
the
problem
we've
got
a
handful
of
problems
here
again,
you
know
in
theory,
you
can
write
the
crd
for
a
an
operator
that
operates
a
an
application.
Now
I've
got
a
problem.
Okay,
so
I've
got
two
versions
that
application
I
want
to
run
simultaneously
and
they
require
different
versions
of
the
operator
and
that
all
goes
a
bit
kind
of
tips
up.
So
it's
where
orchestra
has
a
slightly
different
thing.
It's
basically
trying
to
say
here's
something.
D
You
know
that
would
work
for
any
application,
I'm
more
sympathetic
to
that.
A
little
bit
like
helm
is
also
application.
Agnostic,
it
doesn't
care,
but
again
you
would.
You
would
probably
want
to
write
a
best
practice
on
that
kind
of
crd.
Saying
here
are
best
practice:
versioning
behaviors
for
crds
for
compatibility,
and
you
know
semantic
versioning
and
so
on.
E
Well,
yeah,
I
mentioned
orchestra
just
that
it
solves
the
chicken
and
egg
problem,
so
it
can
separate
the
creation
to
a
different
chart
of
the
crd,
but
there
are
other
challenges
too.
You
need
an
admin
access
or
some
sort
of
elevated
access
to
create
crds,
yeah
workloads
always
have
them.
Obviously,.
G
D
Yeah
and
that's
my
point:
right
orchestra
could
be
a
part
of
a
mandated
part
of
the
platform
because
it's
not
trying
to
be
specific
to
a
individual,
cnf
or
one
vendor's
set
of
cnfs.
It
would
be
a
good
example
of
something
you
could
make
a
mandated
part
of
the
platform,
but
I
think
what
you
can't
do
and
I
think
we
could
write
a
best
practice
to
this
end
right
now
and
sort
of
start
getting
to
the
point
of
yeah.
Well,
the
world
doesn't
work
the
way
it
needs
to
work.
A
At
the
top
of
the
hour,
I
want
to
ask
so
your
intent
on
this:
were
you
trying
to
be
more
general,
or
would
you
like
to
have
the
because
this
is
real?
This
is
your
use
case
you're
putting
forward.
So
where
do
you
want
to
go
with
this?
It
could
be
something
where
you're
saying
onboarding
of
helm-based
or
helm
package
cns
and
talking
about
the
challenges,
if
that's
what
you're
wanting.
But
where
are
you
wanting
to
go
and.
A
G
My
idea
was
to
illustrate
or
to
specify
the
sect
of
practical
challenges
and
expectations
in
general
related
to
to
say
what
we
call
onboarding,
but
it's
more
or
less
installation,
let's
simplify
it,
installation
of
and
cnf
into
the
kubernetes-based
platform,
so
I
would
prefer
to
keep
it
generally.
It
seems
that
it,
it
triggers
some
discussions
on
best
practices
which
we
could
all
refer
to
this.
G
To
this
point,
I
would
if
there
is
an
interest-
and
this
is
a
feedback
if
there
is
interest
to
to
show
deeper,
what
are
the
specific
issues
with
helm?
We
could
go
in
that
way.
Additionally
and
say
this
is
kind
of
umbrella,
because
it's
not
only
too
specific
to
helm,
it's
specific
to
to
what
audience
what
installation
audience
are
vendors
preparing
those
functions.
Is
it
their
professional
services
team
who
gets
specially
trained
for
that
or
it's
experienced
professional
or
csp?
G
What
is
the
best
practice?
What
we
believe
is
it's
open
to
discussion.
It
is
also
how
they
prepare
documentation,
the
prerequisites
and
so
on.
So
it's
a
set
of
things
out
of
which
we
can
either
derive
a
number
of
practices
and
if
we
feel
helm
or
whatever
is
maybe
more
burning
one,
we
can
focus
more
on
that.
G
So
I
would
prefer
to
to
keep
it
in
this
umbrella
mode
and
maybe
make
it
more
general
or
maybe
make
it
broader
to
to
cover,
let's
say
other
aspects,
and
then,
if
there
is
appetite,
I
could
go
and
then
write
a
separate
one
like
use
case,
best
practices
or
challenges
with
the
help
based
deployments,
but
that
one
would
go
then
in
in
the
details
of
where
the
things
are.
Failing
what
specifically
in
helm,
we
see
as
a
challenge
and
so
on.
A
A
How
are
we
communicating
so
if,
if
on
the
use
case,
the
focus
is
around
practices
and
trying
to
solve
certain
problems
and
we're
looking
for
solutions
and
practices
out
of
that
so
you've
kind
of
pointed
out
some
of
these
in
the
in
the
comments
here:
the
packaging
and
distribution
and
other
stuff,
and
so
maybe.
A
All
right
I'd
be
up
for
working
with
you,
some
and
trying
to
see
if
we
can
expand
and
call
some
of
the
things
out,
but
it
sounds
like
we're.
Not
we're
not
saying
here
is
we've
solved
problems,
but
laying
out
a
bunch
of
the
problems
that
are
there.
Maybe
is
what
you're
pointing
out
here.
So
this
would
be
talking
about
the
problems,
and
then
we
may
have
follow-up
use
cases
and
then
eventually
best
practices.
That
point
back
and
say
this
saw
helps.
Try
to
solve
one
out
of
the
larger
set.
A
Is
that
kind
of
the
direction
yep?
So
I
raise
my
hand
I'm
willing
to
work
with
you
either
async
or
we
can
do
some
synchronous.
A
And
we're
at
the
top
of
the
hour
folks,
frederick,
if,
if
you're
available
next
week
to
do
the
talk
about
the
government
regulations
and
cyber
security,
we
can
join
that
yeah,
not
a
problem
that
should
work
all
right
thanks.
Everyone.