►
From YouTube: Water is a Driving Force of Innovation: Open Source in the Dutch Gov... Onno Brouwer & Tomasz Klimek
Description
Don’t miss out! Join us at our next event: KubeCon + CloudNativeCon Europe 2022 in Valencia, Spain from May 17-20. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.
Water is a Driving Force of Innovation: Open Source in the Dutch Government! - Onno Brouwer, Rijkswaterstaat & Tomasz Klimek, Grape Up
Imagine applications dedicated to "Keeping a proper level of water in all Dutch waterways" or "Providing all cargo ships traveling throughout the country with a guaranteed travel slot." Now consider running and maintaining them 24x7 in ‘the cloud’ as a government agency. Failure is not an option. Sounds stressful, right? Running mission-critical systems, meeting all customer requirements, and providing a fully self-service experience is our goal. To do that, we are creating a multi-cloud, hybrid cloud-native application platform based on Open Source technologies, such as Kubernetes, Grafana, Prometheus, Harbor, Minio, or Shield. Providing such services as a government agency is demanding. Awareness of potential damage done by denial of services is also a strong motivating factor. This presentation will cover lessons learned & challenges that happened to our team while planning and building "One platform to run them all”.
A
Welcome
everyone
for
yet
another
presentation
in
on
kubecon
and
cloudnativecon
hope
that
you
have
really
good
conference
so
far
and
you've
been
able
to
see
some
really
awesome
presentation.
We
are
really
happy
to
be
here
and
share
our
story
with
you.
So,
together
with
wanna,
we
wanted
to
present
today
a
few
of
our
business
cases
about
open
source
and
how
the
dutch
government
benefits
from
using
it.
B
A
B
B
Thanks
what
starts
well?
Who
are
we?
What
do
we
do?
We
are
the
executive
agency
of
the
dutch
ministry
of
infrastructure
and
water
management.
We
basically
promote
the
safety,
mobility
and
the
quality
of
life
in
the
netherlands.
Well,
what
safety
about
that's
about?
Protecting
us
against
a
flood
and
high
waters
protect
mobility
is
related
to
the
highways
and
the
waterways
we
have
throughout
the
netherlands
to
to
manage
people
moving
about,
and
the
quality
of
life
is
referring
to
the
environment,
natural
environment,
keep,
netherlands,
green
and
energy
neutral
and
also
quality
of
drinking
water.
A
A
So
it's
it's
really
different
perspective,
I'm
not
from
netherlands,
I'm
from
poland,
so
I
can
give
you
my
opinion
about
it.
So,
usually,
if
you
are
transporting
goods
or
you
want
to
travel,
you
have
your
highways.
You
have
your
local
driveways,
so
you
just
go
into
your
car.
Put
some
cargo
on
the
road
truck
and
that's
it.
A
There
are
ships
traveling
between
countries
on
the
sea
and
and
so
on,
but
the
netherlands
have
really
different
perspective.
There
is
very
rich
network
of
the
water
canals
and
they
are
widely
used
for
transporting
goods
and
people
around
the
country,
and
this
is
pretty
interesting
story
and
it
all
has
started
because
26
of
the
dutch
territories
are
under
the
sea
level,
so
that
means
that
they
need
to
be
drained
in
order
to
be
used.
So,
as
far
as
this
story
has
been
starting
several
centuries
ago,
they
were
the
netherlands.
A
So
what
is
our
mission?
There
are
pretty
important
mission,
critical
systems
that
we
need
to
operate.
There
are
few
teams
that
that
are
the
different
parts
of
this
process,
so
our
goal
is
to
deliver
the
best
tools
and
technologies
that
we
can
use
in
order
to
have
the
most
resilience
environment
and
being
able
to
operate.
In
the
worst
case,
scenarios.
B
A
B
B
Yes,
let's
talk
technology.
We
basically
have
drawn
two
three
pillars
here:
on
the
left
hand,
side
we
have
borsch,
which
is
an
open
source,
vm
orchestrator,
basically
managing
vm
deployments,
and
we
use
boars
to
deploy
automation
tooling,
like
concourse
monitoring
like
rafana
and
prometheus.
We
use
mineo
for
s3
compatible
storage.
B
We
have
shield
for
for
making
backups
and
since
our
standard
workplaces
don't
have
all
the
tooling
on
board
we
would
like
to
have.
We
may
also
manage
a
set
of
jump
boxes
which
we
control,
on
which
we
can
un
install
all
the
tooling,
like
cube,
cubecuttle
cli
for
our
needs,
and
also
our
customers
needs
on
the
right-hand
side.
We
also
have
the
platform
we
started
out
with
cloud
foundry,
which
is
a
past
platform
platform
as
a
service.
B
We
have
quite
a
few
applications
running
there,
and
also
our
major
data
services
are
provided
by
the
platform
like
rabbitmq
for
messaging
and
redis
for
database
usage
or
session
management.
However,
we
are
at
cubecon
cloud
nativecon.
So
let's
focus
on
the
central
pillar
here,
which
is
all
about
kubernetes,
of
course,
and
we
have
also
related
surfaces
like
harbor
for
container
management.
A
Yeah
definitely
so
right
here
on
the
screen,
you
can
see
a
simplified
architecture
of
cloud
booster
platform,
which
is
delivering
the
kubernetes
into
our
operations.
So
going
piece
by
piece.
You
can
see
a
orchestration
layer
at
the
bottom,
the
ops
automation.
This
is
the
layer
where
we
have
kubernetes
delivered
by
cubespray.
A
A
So
we
use
their
hardboard
clair
traffic
and
engine
x
as
a
optional
in
interest
controller,
ingression
controllers-
and
I
guess
you
can
see
a
lot
of
logos
here,
most
of
them,
if
not
all,
are
provided
by
the
cncf
community.
They
are
all
the
cloud
native
landscapes.
So
I
I
guess,
we've
come
to
the
right
place
and
we
wanted
to
show
you
the
technologies
that
we
actually
use
in
our
daily
operations,
but
enough
of
the
enough
about
the
technologies,
let's
dive
into
how
our
customers
are
actually
able
to
benefit
from
them.
B
Yes,
when
you
look
at
open
source
well,
there
are
several
benefits
here
we
listed
what
we
think
are
the
major
ones.
First
of
all,
open
source.
We
can
have,
of
course,
support
through
the
open
source
community
and
not
only
the
community,
there's,
of
course,
also
vendors
around
out
there,
like
you,
for
example,
who
can
help
us
manage
it
all,
because
it's
quite
a
lot
of
technology,
quite
complex,
a
lot
of
story
choices
and
it
helps
to
have
a
vendor
helping
out.
A
That
is
very
true.
Another
important
point
is
starting
immediately,
and
this
is
especially
important
for
the
enterprise
great
companies,
if
you
want
to
use
open
source
the
process
of
using
that
building,
mvp
or
poc,
is
a
lot
quicker.
The
procurement
process.
Everything
is
in
place
right
away,
so
also
the
community
that
ono
has
mentioned.
It's
really
helpful
to
start
immediately
and
have
an
answer
to
your
question.
Will
I
benefit
from
that.
B
A
A
A
Currently,
the
transparency,
you
can
call
it
the
two-sided
swords
that
transparency
is
good
and
bad,
but
currently
is
rather
a
good
thing,
because
if
there
is
any
vulnerability
in
the
codes,
probably
someone
else
has
already
found
it.
There
are
really
major
companies
supporting
the
community
because
they
also
want
to
use
it
on
a
production
in
a
very
demanding
environment.
So
it's
really
important
point
nowadays.
B
And
last
but
not
least,
no
fender
log
in
even
so
we
use
a
lot
of
open
source.
Like
I
mentioned
in
the
beginning,
it's
nice
to
have
a
vendor
helping
us
out.
On
the
other
hand,
we
don't
really
want
to
be
tied
to
a
particular
vendor
and
because
it's
all
open
source,
the
basis
is
all
the
same
for
everyone,
so
that
gives
us
the
flexibility
to
switch.
If
and
when
we
decide
to
do
so,.
A
And
I
guess
I
can
say
all
of
those
benefits
are
also
risks
at
some
point.
So
another
risk
to
to
consider
is:
if
you
want
to
use
the
open
source,
you
really
need
to
know
it.
So
for
every
requirement
there
is
at
least
five
tools
that
you
can
use.
So
that's
why
we
also
wanted
to
show
the
cloud
native
computing
foundation
landscape.
A
A
B
A
A
Hope
that
you
have
already
taken
care
of
that,
as
you
can
see
on
the
picture
using
technology
is
not
always
the
best
idea,
if
you
don't
know
how
to
use
it.
So
it's
always
good
to
know
how
you
can
benefit
from
the
technology
that
you're
picking
and
that's
exactly
our
point
from
the
previous
slide
and
showing
the
cncf
landscape
so
moving
on.
Let
us
talk
a
bit
about
the
business
and
how
do
we
benefit
from
those
open
source
technologies.
B
B
Basically,
we
take
measures
of
water
quantity
like
like
water
levels
and
the
speed
water
is
moving
about
the
water
quality,
think
of
things
like
salination
levels
or
pollution,
weather
information,
whether
the
wind
is
blowing
etc
and
not.
Last
but
not
least,
also
the
state
of
our
objects,
whether
bridges
and
gates
are
open
or
closed
scope.
For
this
all
is
to
basically
smart
water
management
during
drafts
in
high
water,
and
we
also
use
this
input
for
for
the
shipping
reporting
and,
of
course,
last
but
not
least,
it's
used
as
input
for
our
flood
defenses.
A
Looking
at
this
picture,
it
seems
that
the
whole
netherlands
are
like
iot
country,
looks
pretty
nice
and
I
guess
for
me
it's
really
nice
to
see
that
those
receptors
are
not
only
in
the
netherlands
but
also
in
the
countries
around
the
netherlands,
because
you
can
have
early
feedback.
If
there
is
a
flood
in.
B
B
B
B
A
A
So
this
sounds
really
complex
and
it
operates
in
the
whole
netherlands
and
also
gives
a
feedback
to
other
systems
in
in
the
countries
around
the
netherlands.
So
this
sounds
like
a
very
big
planning
job
to
to
process.
So
that's
also
another
good
example:
how
how
to
benefit
from
using
open
source
technologies
and
help
yourself.
B
Yes,
you
not
only
have
a
traffic
jam
on
highways,
but
we
also
might
have
traffic
jams
on
waterways.
Unless
we
take
measures
like
these
here,
we
have
an
exo.
Have
we
have
well?
Not
we.
This
is
really
actually
already
live.
This
is
our
ci
cd,
which
is
part
of
the
ivs
next
project,
our
shipping
management
project.
B
B
Images
are
stored
into
harbor
and
made
available
and
configuration
files
used
by
helm,
helm,
charts
and
the
like
are
stored
in
gitlab.
When
these
are
combined.
You
end
up
with
images
you
can
deploy
in
communities
and
first,
of
course
we
would
put
it
into
tests
and
then
we,
of
course,
we
want
to
make
sure
everything
works.
So
we
run
some
automated
regression
testing.
B
A
A
So
I
I
guess
it's
another
part
of
seeing
a
different
mindset
in
the
netherlands.
If
you
want
to
buy
new
tv,
then
you
can
just
see
the
current
water
model
and
if,
if
it's
a
good
idea
to
put
it
on
their
first
floor
or
the
second
floor,
it's
really
different
perspective,
and
I
also
should
mention
that
in
the
back
end
of
this
application,
there
is
really
complex
water
model
computation.
A
So,
as
far
as
the
it
looks
pretty
simple
at
the
back
end,
this
is
really
complex
and-
and
we
have
a
lot
of
micro
services
doing
that
work,
and
it's
also
very
nice
to
mention
that
the
peak
performance
of
that
application
would
be
during
the
thought.
So
when
it's
actually
needed
the
most-
and
I
guess
I
know
you
can
say
something
about
the
last
usage
that
was
unfortunately
needed.
B
A
Okay.
So
after
presenting
those
business
cases,
we
also
wanted
to
share
with
you
our
lessons
learned
and
the
first
one
for
sure
is
the
quick
communication
and
feedback
loop
during
operating
that
that
big
projects,
big
operations
like
mission,
critical
systems,
you
will
have
a
lot
of
teams.
You
will
need
to
coordinate
the
work
between
them,
so
it's
really
important
to
have
a
quick
communication
and
a
very
good
feedback
loop
just
to
stay
on
top
of
any
issues
and
work
together
on
any
problems
that
we
can
have.
B
Yes,
next
to,
of
course,
communication,
which
is
always
important,
but
we
can't
stress
it
enough
having
the
right
mindset
basically
gain
knowledge,
be
greedy
platforms
are
complex.
When
you
look
at
platforms
like
kubernetes,
there's
a
lot
of
technologies,
a
lot
of
moving
parts,
it
can
overwhelm
you
quite
quickly,
so
so
you
need
to
learn,
be
mindful
keep
learning.
B
B
On
the
other
hand,
having
the
right
mindset
is
not
only
about
gaining
knowledge,
also
about
sharing
it
be
generous,
not
only
within
the
team,
but
also
external
to
the
team.
We
have
a
customer
feedback
loop.
We
meet
regularly
with
our
customers.
What
are
your
requirements?
What
are
your
ideas?
We
can
provide
them
the
information.
What
is
what
we
are
planning?
A
Exactly
that's
a
very
nice
thing
to
do,
and
the
other
part
of
the
mindset
is
that
you
need
to
all
of
the
teams
you
need
to
have
them.
Look
at
the
same
picture
have
the
same
approach.
So
it's
always
important
to
share
and
spread
the
mindset
during
running
those
big
operations.
You
will
have
different
external
teams
probably
will
be
around
delivering
the
platform
or
the
software
delivery.
A
B
B
Many
things
can
happen.
Many
things
can
go
wrong.
Monitoring
can
help
you.
You
can
watch
disks
running
out
of
space.
You
can
use
trend.
Analysis
committees
can
give
you
nice
warnings.
Upfront
like
hey,
this
disc
might
fill
up
in
the
future.
Maybe
you
should
take
action,
that's
pretty
cool
technology
and
very
useful
to
monitor
the
platform.
B
However,
there
are
still
some
dangers.
It's
very
easy
to
fall
into
the
trap
of
okay.
We've
got
it
all
in
control.
We
manage
everything,
we're
monitoring
everything
prime
example.
For
example,
we
had
bosch,
as
mentioned
in
an
earlier
slide,
managing
and
deploying
vms.
We
had
agents
running
all
those
vms
monitoring,
all
the
data
like
cpu
memory,
etc.
Everything
was
monitored,
except
for
one
vm,
the
boss,
director
itself.
B
It
was
not
part
of
the
monitoring,
so,
of
course,
murphy's
law
strikes
and
we
ran
out
of
disk
space
and
we
had
to
fix
things
and
then
we
decided.
Okay,
we
have
to
fix
a
blind
spot
next,
to
monitoring,
of
course,
one
of
the
main
activities
we
deploy
whenever
we
come
across
something
we
have
to
do
twice.
We
think
maybe
we
should
automate
this.
We
have
a
pretty
small
team.
We
have
to
manage
platforms
running
hundreds
of
applications
so
to
keep
it
manageable.
We
try
to
automate
wherever
we
can.
B
We
want
to
use
a
version
control.
We
don't
want
to
get
automatically
the
haters
the
latest
and
greatest.
We
can
want
to
keep
things
in
control.
We
want
to
make
sure
the
business
is
repeatable
predictable
and
keep
everything
up
to
date
and
also
make
sure
environments
are
consistent.
We
also
use
automation
not
only
for
platform
updates,
but
also
for
things
like
automated
reporting.
B
B
That's
that's
an
that's
an
idea
which
we
don't
really
see
a
lot
of
people
doing,
but
to
us
it
was
like
a
life
saver.
We
run
automated
smoke
test
every
few
minutes
check.
If
the
platform
is
still
operational,
can
we
deploy
applications
and
also
are
all
our
backing
services
like
rabbit
queue
or
postpress?
Are
they
all
still
available
unreachable?
A
And
the
nice
thing
about
it
is
that
in
the
office
in
delft,
where
our
team
is
located,
there
is
a
huge
screen
on
the
wall
and
yeah.
The
whole
result
is
visible
to
everyone
in
the
team.
If
you
are
working
from
the
office
of
course,
we
just
need
to
add
the
special,
let's
say
animation,
that
if
everything
anything
goes
wrong,
we
should
have
this
fire
on
the
wall
and
some
siren
going.
That
would
be
pretty
nice.