►
From YouTube: Using Cloud Foundry Container Runtime to Run Your Kubernetes Clusters - Oleksandr Slynko
Description
Using Cloud Foundry Container Runtime to Run Your Kubernetes Clusters - Oleksandr Slynko, Pivotal & Kaiting Chen, VMware
Cloud Foundry Container Runtime (CFCR and formerly Kubo) is an OSS project developed jointly by Vmware, Pivotal and Google. It provides an uniform way to instantiate, deploy, and manage highly available vanilla Kubernetes clusters using BOSH - on GCE, vSphere, AWS, Openstack and Azure.
Using BOSH and CFCR to manage Kubernetes gives self healing, easily upgradeable clusters with managed secrets rotation. Cluster creation is simplified to the point where clusters can be created and destroyed for use in development or sandbox environments.
In this presentation, Oleksandr and Kaiting will demonstrate deployment across multiple IAASes, cluster healing, cluster upgrade and cluster creation.
About Kaiting Chen
Kaiting is a staff engineer at VMware. He is an active contributor to Cloud Foundry Container Runtime, working alongside with the Pivotal engineers.
Previously, Kaiting was the CTO and co-founder of a fintech patent-pending startup, developing an exchange for the transaction of illiquid securities initially intended for crowdfunded equity.
About Oleksandr Slynko
Oleksandr is the anchor of Pivotal Container Service project. Before he was working on Cloud Foundry Container Runtime since the project inception. | Oleksandr has a background in automation and working on high available cloud solutions.
A
A
So
I
I
expected
all
of
you
agree
that
Bosch
is
awesome
to
deploy
things
and
it's
awesome
deployment
system
and
the
thing
is,
it
is
called
for
the
cataract
I'm
just
another
boss
deployment
said:
if
you
know
how
to
deploy
this
Porsche
can
do
it
and
Vantage.
Yes,
it's
just
another
board
deployment.
A
bit
fine
service
that
uses
some
extra
Bosch
features.
What
is
just
another
board
appointment.
B
So
I
wanted
to
start
by
talking
a
little
bit,
because
this
is.
This
is
the
first
session
of
the
day
about
why
we
want
to
while
we're,
even
here
talking
about
kubernetes.
What
does
kubernetes
give
you
in
addition
to
your
existing
cloud,
foundry
infrastructure,
so
there's
a
couple
of
things:
the
abstraction
that
kubernetes
built
is
fundamentally
at
a
lower
level
than
what
you're
gonna
see
out
of
the
application
runtime
it
handles
that
deals
with
pods,
which
are
essentially
just
co-located
containers,
and
it
also
means
that
you
can
essentially
run
any
existing
docker
container.
B
For
example,
if
you
have
something
like
some
persistent
disks
in
your
vSphere
infrastructure,
for
example,
that
you
want
to
use
with
your
with
your
workloads,
then
kubernetes
makes
it
very
easy
to
make
that
integration
happen
and
last
kubernetes
supports
rolling
updates
for
your
workloads
and
makes
it
very
easy
for
users
in
addition
to
access
all
of
these
features.
So
that's
why
we're
here
to
talk
about
kubernetes,
but
the
problem
with
giving
you
all
this
power
and
having
these
low-level
abstractions
is
that
kubernetes
is
very
difficult
to
install
in
a
production
environment.
B
It's
it's
not
hard
to
get
started
with
I.
Think
probably
a
lot
of
you
have
tried
to
use
something
like
mini
cube,
where
you
have
kubernetes
running
on
your
local
machine
and
you
don't
need
any
infrastructure
really
to
bring
up
a
kubernetes
cluster
at
all
and
that's
that's
really
easy
to
get
started
with.
But
if
you're
talking
about
running
kubernetes
in
an
enterprise
environment
or
in
a
production
environment,
then
there's
a
lot
more
that
you
have
to
think
about
a
lot
of
considerations
that
you
wouldn't
have
in
just
a
development
environment.
B
So
the
first
thing
I'm
going
to
talk
about
is
security,
because
kubernetes
is
kind
of
meant
for
you
to
run
fast.
It's
it's
meant
for
you
to
go
and
get
started
very
quickly,
which
means
that
some
of
the
defaults
that
they've
chosen
are
not
the
best
for
for
production.
These
are
some
quotes
that
I've
taken
directly
out
of
the
kubernetes
documentation.
B
You
see
that
by
default,
Kubla
is
unsecured,
so
any
work
worker
node
that
you
have.
If
someone
were
to
gain
access
to
that
network
and
we're
able
to
ping
that
node
well,
they
could
run
whatever
workload
they
want
on
that
worker
node.
You
also
have
to
think
about
things
like
user
authentication.
In
fact,
here's
basically
a
list
of
the
security
considerations
that
you
have
to
have
to
worry
about
when
you
bring
up
a
production
kubernetes
cluster,
if
you
want
to
have
actual
users
where
you
need
to
give
kubernetes
an
external
user
and
external
authentication
provider.
B
So
how
are
you
gonna?
Do
that?
How
are
you
gonna
get
those
components
to
talk
together?
How
are
you
going
to
tie
that
into
your
authorization
and
like
governance
infrastructure
so
that
those
users
can
only
access
the
resources
that
they're
supposed
to
you
have
to
worry
about
certificate
management
because
kubernetes
kind
of
decentralized
right,
it's
kind
of
modular
and
all
the
pieces
ideally
should
be
communicating
using
mutual
TLS,
which
means
that
you
need
to
manage
certificates.
You
have
to
worry
about
securing
couplet.
B
You
have
to
worry
about
securing
at
CD,
which
is
the
brains
of
this
whole
operation.
You
have
to
worry
about
credential
rotation
for
your
service
accounts,
and
you
also
have
to
worry
about
securing
things
like
the
dashboard
that
people
often
forget
and
lead
to
hackers
running.
Cryptocurrency
miners
in
your
infrastructure,
so
like
none
of
these
things
are
things
that
none
of
these
problems
are
really
insurmountable,
or
anything
like
that
they're.
Just
an
additional
factor
that
you
have
to
consider
when
what
you
really
want
is
to
just
get
a
cluster
up
and
running.
B
How
do
you
know
that
cluster
is
going
to
continue
operating
the
way
that
you
want
it
to
after
you
take
down,
for
example,
some
of
your
workers
for
maintenance,
how
you
confident
that
your
Kubla
is
going
to
be
able
to
come
up
successfully
or
that
your
cluster
is
going
to
survive
and
upgrade
so
again
a
lot
of
things
to
think
about
when
deploying
kubernetes
in
production,
because
it's
like
essentially
infrastructure.
And
that
means
that
you
have
to
think
about
all
the
ramifications
that
come
with
that
infrastructure.
B
And
last
you
throw
networking
into
this
picture
and
it
gets
just
a
lot
more
complicated
if
you
want
a
resilient
cluster.
Well,
that
means
that
you
need
highly
available
masters
and
there's
no
way.
Kubernetes
gives
you
built-in
to
have
that
master
high
availability,
which
means
that
you
need
to
go
and
set
up
your
own
load
balancing
solution
or,
if
you're,
using
some
sort
of
cloud
infrastructure
there.
Well,
you
need
to
set
up
an
external
load
balancer,
so
this
is
again
taken
directly
from
the
kubernetes
documentation,
that
quote
and
this
diagram.
B
This
is
what
they
suggest
you
set
up
by
yourself
if
you
want
a
resilient
highly
available
master
so
that
that's
like
a
lot
of
work
for
us
and
then
you
throw
in
mutual
TLS
into
all
this,
you
throw
in
DNS,
and
then
you
have
to
worry
about
like
this
situation.
If
you
have
that
load
balancer
sitting
in
front
of
your
masters,
then
your
workers
need
to
talk
to
the
master
notes
through
that
load
balancer.
How
are
you
going
to
ensure
that
your
masters
are
presenting
an
SSL
certificate?
B
That's
going
to
be
accepted
by
the
workers
and
what
have
you
need
to
rotate
that
certificate
like
over
time
or,
for
example,
the
IP
address
of
your
load,
balancer
changes
or
the
DNS
name
of
it
changes?
How
are
you
going
to
ensure
that
all
these
certificates
are
accepted
by
both
the
masters
and
the
workers
so
like
this?
Is
it
like
I
said
like
none
of
this
is
really
it's
not
something
that
you
can't
do
it's
just
a
lot
to
think
about.
So
what's
the
solution
to
all
this
so.
A
Resurrecting
VMs,
it's
all
great
features
of
Bosch,
but
today
I
won't
specifically
talk
about
two
recently
new
features.
Recently,
it's
one
half
year
old
features
that
Bosch
provider
that
allowed
us
to
build,
call
for
the
container
runtime
and
allowed
us
to
merge
multiple
clusters.
One
of
it
is
bore
genus.
It
allows
us
to
remove.
A
Load
bars,
are
out
of
equation,
is
bossiness,
it
provides
easy
master
che
and
you
film,
you
just
specify
some
alias
and
it
works
like
kind
of
like
internal
load
balancer
and
if
master
goes
down,
then
it
cuts
removed
from
this
DNS
record.
And
who
is
this?
It's
you
don't
need
external
load
bars
or
for
internal
communication.
If
you
need
to
talk
externally,
you
want
it,
you
can
have
it
what
you
don't
need
and,
more
importantly,
you
opera
doesn't
need
to
configure
anything.
A
So
it's
york's
all
the
same
for
different
clusters.
It
provides
so
discovery
for
different
clusters,
discovery
of
HCD,
I
discover
of
masters
from
brokers.
So
this
way
we
just
felt
the
same
on
different
clusters,
but
additionally,
we
want
to
try
certificates
and
cred
hub
cry
hub,
really
solved
all
those
problems
you
are
able
to
derive
certificates
for
all
the
components
provide
mutual
TLS
generates
all
the
passwords,
especially
one
that
you
don't
really
care,
as
it
required
only
for
telecommunication.
A
It
significantly
simplifies
multiple
cluster
management,
because
operator
doesn't
need
to
think
about
it.
They
just
have
one
manifest
and
have
to
change
diploma
time,
as
I
said
and
I
will
show
how
it's
happened
right
now,
so
I'll
just
deploy
jerrick
CSR
cluster.
To
be
honest,
I
I
already
deploy
this,
so
we
will
have
time
to
see
some
other
things
and
I
will
just
some
I
get
sample
manifest
from
Cooper
deployment.
It's
manifest
I'd
provide
by
CFC.
Are
this
is
minimal
manifest
you
can
deploy
it
on
each?
Is
it
feeldog
fine?
A
So
if
you
don't
need
any
cloud
features,
it
will
work.
Fine
if
you
need
some
collaboration.
This
cloud
like
connecting
disk
a
lot
of
answers.
You
need
to
provide
settings
for
so-called
cloud
provider
and
that's
why
I
connect
this
additional
ops
file.
Then
one
more
thing
kay
Terrence:
there
will
be
session
about
color
k,
Terrence.
What
you
need
to
know
it
will
speed
up
your
deployment,
then
I,
because
I
won't
discuss
to
be
excessive.
A
Externally
I
will
add,
load
beside
Peter
certificate,
add
masters
to
the
slaughter
balancer
and
provide
some
variables,
so
those
variables
required
to
tag
VMs
or
cluster
knows
okay.
This
is
a
part
of
this
cluster.
They
can
attach
disk
and
so
on,
and
these
variables
are
required.
Talk
to
GCP
click
enter
it
build
on.
It
will
take
about
one
minute
and,
as
I
said,
the
first
part
of
the
manifest
is,
however,
for
any
cloud,
and
once
you
have
CR
said
that
they
adding
support
for
different
clouds.
A
It
just
means
a
date
called
provided
support
for
different
clouds.
Now
each
developer
or
covariance,
developer
or
commerce
operator
expect
sound
or
clause
to
be
Ryan
on
vanilla
cluster,
so
one
of
it
is
cube
DNS,
which
allows
still
discover
inside
the
cluster
cabanas
dashboard
that
you
can
see
in
pretty
yo
what's
happening
is
a
cluster
and
hipster
for
matrix.
So
this
is
what
is
done
in
this
around
and
because
I
used
Calicut,
and
it
will
run
very
very
quickly
because
it's
run
on
the
master
VM
and
it's
already
finished
now.
A
It's
gettin
logs
and
printout
logs,
so
I
will
show
how
it
works.
Just
part
of
the
manifest
so
I
added
one
job
to
the
master
and
moves
it.
A
separatist
has
group,
since
this
is
ops
file
for
the
load.
Balancer
I
just
had
am
extension
and
IP
just
IP
in
variable
now,
I
want
to
connect
to
the
cluster.
So
I
owe
my
credential
sign
cried
hub,
I
need
to
get
them
from
crud
happened.
This
is
I,
get
client
secret
connect
to
this
crud
hub.
A
It's
connected
get
the
token
that
I
used
to
authenticate
get
the
CA
certificate
and
side.
My
cube,
config
circuit,
config
and
cube
keep
CTL,
for
example,
get
notes.
I
can
see
it's
up
and
running
it's
available
externally.
So
I
will
connect
to
my
local
machine
and
I
can
do
eclipses,
ETL
city
I'll
get
all
get
notes
as
well.
It
will
be
the
same
notes,
so
what
I
can
do?
I
can
deploy?
Samuel
Claude
keeps
ETL
apply
with
file
assistant
volumes
well,
create
disk,
create
some
deployment
it's
up
and
running
and.
A
Proxy,
as
I
said
it
has
dashboards,
so
I
can
access
dashboard
from
my
local
machine
and
ok.
It
says
I
need
to
login
and
I
need
to
provide
my
keeps
ETL
file.
Keep
config
file,
I
will
provide
it
and
I
can
sign
in
and
proceed.
So,
even
if
your
dashboard
is
exposed,
you
still
need
Samson
taxes
and
it's
the
floor,
and
you
can
see
that
I
start
deploying
this
guestbook
and
sometimes
deployed
some
nice.
A
You
are,
if
I
refresh
it,
it
will
update
something
I
hope,
yeah
nobody's
up
and
running,
so
cluster
is
up
and
running.
I
will
go
back
to
the
remote
VM
and
I
can
get
keep
CTL
get
service
front-end,
so
I
know
how
to
connect
it,
and
this
is:
let's
go
guestbook
it's
up
and
running
it's
on
public
IP
address,
so
you
can
hello,
CEO
summit.
You
can
connect
it,
but
but
please
don't
because.
B
A
Steal
Internet
can
connect,
do
it
afterwards,
so
I
deployed
cluster
I.
You
scratch
up
to
get
credentials.
I
deployed
using
vanilla.
Cfc
are
I
added
some
ops
file
just
to
optimize
speed
of
the
deploy,
neurons
I
get
access
to
it.
It
is
working,
but
in
real
life
you
probably
don't
want
to
expose
your
masters
to
the
external
Internet.
You
want
them
to
be
available.
Internal
network
and
I
need
to
have
some
kind
of
jump
box
to
access
it,
and
this
is
what
we
will
do
right
now.
A
We
will
I
will
show
the
several
possible
patterns
that
we
can
use
to
connect
to
your
cluster,
the
deployed
in
just
internal
network,
so
I
came
back
here
and
I
go
here
and
I
will
high
deploy
second
cluster
as
well.
The
sensor
manifest
same
cloud
provider,
Calicut
errant
expose
links.
I
will
find
later.
Why
rename
deployment
and
nothing
about
soil
bouncer.
So
it
doesn't.
It's
not
run
as
part
of
Florida
browser.
It's
not
available
externally
and
basically
I
won't
be
able
to
access
it
anyway,
except
from
going
Saha
from
internal
network.
A
So
I
will
deploy
arrant
and
to
do
this,
I
will
deploy
Jambox
separately
in
the
it's.
The
same
motion
fetching
logs
I,
will
show
expose
links
to
just
basically
exposing
links
and
making
them
available
between
cross
deployment.
Jambox
I'll
also
deploy
Jambox
I
deployed
everything
just
half
an
hour.
It's
not
that
much
and.
A
Manifest
of
this
jam
box
I
have
both
dienes
to
be
able
to
use
the
same
service
discovery
but
from
different
deployment.
This
is
why
had
this
links
shared
because
those
links
provides
genus
discoveries
in
commodious,
aliases
I
can
connect
to
the
cluster
via
the
same
DNS.
Name
from
this
john
box
then
keep
CTL
is
one
of
the
iro,
this
tiny
job
to
show
how
you
can
access
the
cluster
from
John
box
and
screwed,
a
simple
HTTP
proxy
and
nothing
more
interesting.
A
So
again,
the
same
connect,
the
cred
hub
and,
as
you
see,
it
has
to
2008
one
from
CFC
are
and
other
four.
She
observed
agent
that
I
just
deployed-
and
this
has
been
charted-
automatically
haven't
done
anything
and
in
CSR.
Sturgeons
are
lots
of
credentials
and
I,
basically
don't
care
what
was
I
if
I
need
I
can
rotate
any
of
them,
but
as
operator
I,
don't
need
to
have
them
on
my
computer
at
all.
A
I'll
get
the
token
I'll
get
is
a
series
short
and
now
I'll
try
to
connect
the
CCA
short
with
just
talking
to
master
steps
are
internal
which
is
DNS
alias
for
this
coastal
and
unfortunate.
Does
it
joke
because
I
actually
need
John
box,
so
I'll
get
John
box
and
I'll
get
connected
at
John
box
on
this
script,
I'll
get
John
box,
API
doesn't
using
the
jump
box.
A
I
will
try
to
get
some
information,
so
I
got
those
notes,
as
you
can
see,
and
now
I'll
deploy,
simple
nginx
application
that
I
got
from
CFC
are
and
just
wait
for
it
to
finish,
and
it's
deployed.
So
sometimes
it
takes
time
to
download
images,
but
I
tried
it
several
times
so
Oleum
we
just
as
air.
This
is
why
it
deployed
so
quickly
and
now
I
need
to
wait
till
load
bar
setup,
but
unfortunately
it
says
ensure
load
balancer.
A
So
it's
still
starting
up
and
I
need
to
wait
for
some
time
and
it
talks
as
the
coastal.
So
I
wanted
to
show
you
how
you
can
access
cross
a--from
this
Jam
box,
and
maybe
it
won't
be
John
box
for
you
might
be
it
will
be
some
DM
and
you
see
I
may
be
in
Congress
rocker,
so
I'll
just
connect
this
jump
box
SSH
and
what's
important
from
it.
I
can
obviously
nslookup
master
CFC
our
internal
catch.
A
Three
masters
the
hell
advanced,
so
we
have
a
chain
and
then
I
get
four-week
up
jobs,
cube
CTL
being
keeps
it
here
again.
Good
service
and
I
can
see
at
my
genetics,
top
and
Ryan,
and
this
keeps
ETL
job
is
just
simple:
I
have
talking,
I
have
certificate
authority
and
I
can
show
you
talking,
because
this
class
is
not
available
externally,
you
won't
be
able
to
connect
to
it,
but
we
can
connect
to
this
York
lot.
A
B
A
Developers
won't
even
need
to
know
anything
about
keeps
ETL
and
your
course
will
be
still
available
externally
sets
each
that
we
wanted
to
show
you.
There
are
much
more
things
and
I
will
do
much
more
topics
on
this
today
and
tomorrow.
So
first
is
important.
Think
is
manifest
with
four
CFC.
Are
you
stuck
to
the
ocean?
If
you
want
testator
shion's
next
link
is
link,
is
demo
and
link
with
my
jam
box
deployment.
A
A
A
Question
was:
if
we
allow
user
to
provide
custom
cloud
provider
or
do
they
have
to
configure
it
all
the
time.
So
this
cloud
provider
is
provided
by
kubernetes
and
basically
operator
needs
to
configure
it.
If
you
want
Doc's
as
a
cloud,
you
need
to
configure
something
you
need
to
have
credentials
which
I've
said
using
cloud
config
in
Bosch,
and
you
need
to
set
some
parameters
in
future
a
long
long
long
future.
What
we
want
and
it's
vosch
cloud
provider.
A
We
want
kubernetes
to
talk
to
boss
and
say
please
give
me
disc
and
Bosch
will
create
disk
attached
to
this
node
and
it
will
rock
a
board.
Give
me
Lord
Bowser,
which
potentially
might
happen
there
is
there
are
some
scenes
in
the
wash
nodes
so
in
the
future.
You'll
use
Bosch
built-in
settings,
and
you
won't
need
to
configure
this
cloud
provider
at
all.
But
for
now
yes,
you
need
to
configure
it
set
some
settings
and
there
are
some
limited
set
of
settings.
Is
there
all
in
documentation.
A
It's
right
now
project
does
not
support
it.
I
think
so.
The
Heretic
I
haven't
tried.
Okay,
it's
all
it's
not
supported.
I
haven't
tried,
but
it's
possible
because
of
links,
it's
possible
to
get
this.
If
you
deploy
at
CD
with
borscht
separately,
you
can
get
access
to
the
8
CD
from
the
master
and
it
doesn't
need
to
be
Calicut
it.
It
can
be
external
or
it
can
be
run
on
separate
VM,
but
I
don't
think
it's
officially
supported.
So
there
might
be
some
issues.
You
know
you
have
to
do
it
manually
and
check
it
manually.
A
My
question
was:
is
they
want
to
scale
by
three
master,
sir,
and
if
CFC
are
caused
by
default?
Is
one
master
in
Georgian
0-16
that
last
released
your
Shan?
It
cows
is
one
master.
Who
is
the
ocean
0:17
that
is
not
released
yet
there
we
highlight
unsure
what
will
be
the
default,
what
it's
possible
to
use
three
masters,
and
this
is
come
on.
This
is
what
I've.
This
is
what
I've
done
so
I
from
these
John
box.
If
I
would
go
again,
I
have
three
masters.
No
jokes,
but
yeah
Rock
is
not
finished.
A
A
Suppose,
director
custom
sets
like
information
about
which
films
are
up
and
reach
her
down
in
particular
deployments,
but
so
I
don't
think
that
states
like
something
big
cry
knows
it
also
director
I,
suppose
all
the
raw
or
Cali
but
I,
don't
know
details
if
you
really
want
to
find
out,
as
I
will
do
boss
office
hours
after
the
stalk
come
and
asked
me
tree.
Oh
I
know.
C
A
A
Okay,
okay,
yeah
I,
get
question:
why
do
you
want
to
run?
Cabarrus
is
called
Fondren.
Those
are
two
parts.
One
part
is:
why
do
you
want
to
run
kubernetes
and
if
you,
if
you
so
I,
will
ask
it
a
little
bit
later?
Why
do
you
want
to
occupy
Swiss
Cloud
Foundry?
If
you
have
Cloud
Foundry,
you
probably
want
operator
to
have
the
same
tool
to
operate.
You
are
the
deployments,
so
that's
kind
of
obvious,
but
why
do
you
want
to
run
kubernetes?
A
It's
supporting
called
foundry,
but
as
far
as
I
know,
Cabernets
has
more
configuration
with
it
then
extensibility,
it's
very
big
part.
So
it's
really
easy
to
extend
kubernetes
and
some
developers
I
get
used
to
kubernetes.
They
like
they
prefer
gobias
to
call
foundry.
There's
some
legacy
of
your
clothes
that
it's
very
hard
front
on
cloud,
fondant,
very
easy
to
run
on
kubernetes.
A
There
are
some
patterns
like
run
inside
cars
and,
for
example,
some
specific
routing.
If
you
want
to
have
specific
routing,
you
have
to
go
to
kavadis,
we
can't
go
on
Godfather
and
change
your
routing
UDP.
You
can
argue
about
this.
You
can
turn
on
foundry
GPU.
We
will
probably
with
new
stem
cells,
will
be
able
to
run
GPU.
Your
closest
kavadis
I
know
I'm,
not
sure
what
will
happen
is
code
for
it.
I
don't
know
so
that
is
like
some
use
cases.
But
yes,
one
more
question.
A
So
question
was
about
ipv6
and
persistence.
If
Iran
is
any
issues,
is
ipv6
and
persistence?
Hi
I,
don't
know
I'm,
not
so
right
now,
I'm,
not
part
of
the
CFC,
our
team
and
I.
Don't
know
what
is
issues
with
ipv6.
What
is
the
current
state
and
this
resistance
I
know
that
there
are
so
many
easy
ways
to
shoot
yourself
and
in
your
feet
and
make
it
not
your
can't
break
it,
and
there
are
so
many
configurations
that
we
covered
most
of
them,
but
some
of
them
just
don't
talk,
because
we
don't
know
about
specific
configurations.
A
A
You
can
deploy
it
with
kubernetes
Zen
covers
will
have
to
handle
it
and
watch
for
the
like
that.
It's
alive
and
to
house
checks
it's
it's
me.
Okay,
I
know
that
yeah.
So
it's
we
I,
don't
think
there
is
a
plan
to
do
I
to
it
to
be
a
part
of
something
it's
called
for
the
Catalan
time
team
will
do
what
if
someone
else
will
do
it
they
were
supported.
Is
that
the
thing
like
it's?
This
is
why
we
said
we
need
you.
We
need
you
to
help
us
and
deliver
such
features.