►
From YouTube: App Testing at Scale: How Bitnami Tests Thousands of Releases Per Month - Juan Jose Martos Castro
Description
Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2021 Virtual from May 4–7, 2021. Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.
App Testing at Scale: How Bitnami Tests Thousands of Releases Per Month - Juan Jose Martos Castro, VMware
Bitnami publishes a collection of over 180 open source applications and components on over twenty platforms, resulting in thousands of unique image builds and releases every month. Every single one of those releases is automatically tested in the environment in which it will be deployed by users, before being pushed to its destination. In this session, we will show you how we automate thousands of tests across multiple platforms including public clouds, vSphere, containers and Kubernetes, and even Windows installers. Using the popular open source blog application WordPress as an example, we will demonstrate how we accomplish this scale of testing and how you can apply what we have learned to your own testing best practices.
https://sched.co/ekB4
A
The
verb
and
disease
juan
josé
martos
combines
my
friend
in
sixteen
jon
albizú
innova
dynamite
are
based
are
realists.
Exchange
16
john
will
be
used
for
those
to
the
network
and
family.
We
dynamic,
because
you
wilder
no
matter
my
hours
to
provide
you
with
the
lakers
version
of
the
dynamic
solutions,
gente
diferente
mark
thesis
and
family
huevina.
My
editor
of
naval
war,
with
the
angel
infrastructure,
looks
like
a
bag,
gavin,
newsom
practice
and
simply
gulf
air
lines.
A
A
We
support
from
media
blogs
providers
artist
moment
batman
gaming
from
catalog
that
religion
in
buy
these
six
are
an
obverse
about
the
world.
We
do.
We
are
trying
five
hundred
companys
imbert
upstream
riders
water
tension
using
the
ladies
version,
1
Reuters,
the
waiting
to
south
and
five
hundred
test,
darwinius
and
dancing
in
resolutions
surfing
working
perspective.
A
A
A
Show,
let's
stay
with
the
technical
partner
help
without
the
title:
automation,
mis,
profes
and
all
the
steppes.
You
can
see
indices
light
represent
what
the
dynamic
dance
dukes
like
it's
raining.
Therefore,
6
define
my
family
and,
if
floyd
a
mole
to
energize
solution,
dark
knight
dynamics,
33
consumer
of
the
point
solutions
gives
them
a
little
bit
with
every
externo.
A
The
first
ones
burn
version
that
remain
of
dolores
version:
seven
tracks
per
new
version
in
de
upstream
projects
agency
using
the
latest
version
of
those
combo
sells
them.
Downloader
gets
de
sold
out
of
those
applications
in
store
day
in
the
meaning,
dataviz
uy
super
forma
additional
actions,
wing
preparing
de
dynamite,
teach
surprise
building
year
of
explanation,
very
big,
send
install
take
to
be
there
or
de
send
six
hour.
A
Indicate
in
tutor
please
contain
in
charters
we
performance
on
june
and
validation
dal
tile
vytorin
about
later
now
that
we
had
been
open
without
content,
endorsement
lunch,
arbil
steps,
product
teachers
and
feel
also
using
the
latest
version
of
the
dynamic
components
to
sequels
of
later
feels.
Sharpeville
empathy
step
will
automatic,
nor
what
delight
they
hide
in
their
daughter
félix
duarte
from
the
chat.
A
This
is
war
just
plain,
and
we
can
see
that
from
the
block
wayne
building
the
love
we
are
running
de
cricket
and
meetings
and
brain
toman
is
good
and
effective,
and
the
city
that
I
attack
you
mans
hallows
until
even
delights
version
of
the
system
bacarisse
inside
the
vitamin
content,
one
according
to
the
law
of
absolution.
We
will
include
the
new
container
that
we
have
the
spirit
and
about
the
eid
virus
is
so
that
perhaps
the
web.
A
Visualization
system
consists
of
making
two
tools:
scripts,
a
country
from
fans
of
hacking
to
perform
hallyday
ting
from
disseny
applications,
fattening
support
term
rousset,
o
tours
and
spirits,
art
scanning
tools,
project
teran,
no
good.
The
ability
containing
charts
by
testing
tour
live
appetite
for
aspe.
A
Yes,
given
the
stoppers
background
and
serena
in
simple
solutions,
mention
william
scanning
different
condense
chance
to
find
interest
in
no
age
ability,
content
hobby,
the
egg
automatically
adb,
hell
two
sentences,
your
mitigation
of
tap
in
order,
your
vision
of
chad,
campbell
from
corning
wing
diploid
news
in
the
force
to
put
environments
tom
hanks
action
that
we
all
superphone
are
gay
prosthesis
gave
without
left
to
break.
Take
with
luck
to
be
won
great
of
solutions.
Plot
requested
is
verse
me
without
competing
for
casper.
A
Yes,
we
can
do
racing
external
link
to
nation
of
we
can
loading
in
all
application
or
in
style
and
planning
now
well
without
sun,
by
jane
new
saints
for
vending
jobs
with
application.
Mary
wilson,
that
the
internal
application
acs
scripts
line
l6
that
we
can
content
gases
in
the
south
of
the
country
exists,
org
binary
change.
That
club
runs
live
from
application
to
meet
it's
time
for
catalog
wealth
example,
twitter,
wordpress,
joomla,
red
line,
and
we
are
not
only
test
in
the
application
son.
Take
care
of
this
amount
components
of
aline
club
inside
the
project.
A
Only
paul
example:
implicate
of
wordpress
take
care,
testing,
give
old
baseball
kings
own
walking,
I
got
tired
and
heavy
starting.
His
bearing
platforms
are
the
one
vision
for
covered
by
solutions
environment
you
can
run
and
not
from
means.
2
providers,
no
mother
and
violin
without
marching
through
the
company
virtual
machine
oren
aviv
install
like
this
too
now
multiply
solution.
A
We
take
us
the
pipeline
burps
with.
We
can
see
that
if
the
times
gwynn
jr
takes
care
of
taking
the
charles
solution
works
pro
tad
after
installing,
without
not
for
me,
but
for
doing
the
setting
of
default
for
'meter
touring
its
crystals
john
williams
april
8
hay
test
works
pro
felipe
martel,
a
breaking
application,
programming
wersching
and
are
going
to
kind
of
dynamics
and
wikis
such
a
solution.
A
Amper
form
other
time
context
in
order
to
install
solution
a
one
to
the
greek
repository
angol
de
leyes
version
of
the
bing
ambit,
which
is
brooke
hogan
y
se,
le
instale
using
the
home,
and
I'm
highlighting
there
wanjiru
buscó
mans
you.
We
need
to
wait
for
the
application
to
be
red
y.
Let's
get
it
status
now.
A
Letsts
and
obinna
mides
of
blogging
loud
functional
al.
You
can
see
your
dynamic
blogging
log
out
the
script
dar
using
kasper,
yes
to
affects
application
of
the
breach
of
what
are
windows,
mobile
credentials
and
the
log
out
funk.
Unemployment
prevention,
2
unions
are
the
fine
line
nextel
and
fire.
The
log
in
fashion
week
for
the
selectors
own
music
from
inputs
that
we
have
provided,
and
you
from
your
blog
in
painting,
richness.
A
A
A
A
A
A
A
A
Let's
get
now
the
results
of
the
external
validation
we
were
talking
before
and
internal
validation.
You
can
see
here
we
could
log
in
to
the
application
properly
and
post
hoy
viven
los
animales
to
the
application
de
usted
web
para,
your
full
milk
of
interner
validation.
Now
you
can
see
that
the
information
is
the
same
one,
that
I
want
what
she
will
be
form.
A
A
Where
we
have,
it
is
ready
to
win
to
work
on
thames
wrong
and
time
and
we
all
in
one
day
of
contents,
very
delights,
version
of
the
system
country
by
genius
of
the
richter
component.
Next,
this
configuration
to
the
azurri
list
contain
every
day
with
that
meet
in
to
be
world
about
tenido
derby,
ley
sinde,
you
can
see
you
wish
list
a
new
version
of
the
week
in
bignami
solution
hours
ago,
de
bagua,
johnson,
release
and
other
version.
A
day
ago,
de
la
mano
de
haber
ser
tu
days
ago,.
A
A
Billordo
priority
and
we
take
followers
of
series
of
dynamic,
not
bad,
building
serve
as
a
base
for
internet
news
for
forest
in
anius
and
a
verismo
extensor
have
signed
up
with
the
reality
affecting
actor
the
sound
keep
by
which
guy
is
very
happy
of
solution
to
add
possible
vadis
bus
take
from
indeco
customer
solution
relief.
All
that
nice
is
being
processed,
find
and
physics.
In
my
conviction
of
tingüindín
link.
The
code
link
automedican
left
indicated
there
is.
There
is
a
tubey
south
of
new
understand.
A
Even
so,
if
our
car
mail
york,
prosthesis
arts,
more
ya
new
dawn
tv,
a
robusta,
but
the
ones
are
not
de
oli
lesson
julian
wilson,
the
wind
y
to
preview,
the
library
of
es
adjustable
winnie
to
ensure
that
we
are
testing
running
functional.
It
is
y
mold
applications.
We
are
telling
es
so
important
balance,
quality
versus
sporting
of
all,
aimed
at
between
23
and
running
correct.
A
Finally,
football
is
one
of
four
pillars
and
you
need
to
provide
people
you
get
in
the
wind.
The
happening
questions
show
what's
next
to
get
in.
You
guys
support
from
your
heart
depository
6
audi
ford
will
find
air
the
information
about
how
to
install
them
in
your
own
environment,
jubilant
fine
day,
tutorials
and
notebooks
2
dynamic
with
six
solution
project
attempts.
You
know
you
can't
go
to
airmen
side,
dynamited
kong
and
get
the
different
solutions
and
there
I
want
to
get
smart
from
home
love.
A
You
can
visit
your
two
well
welcome
to
learn
more
about
por
comercial,
o
free
del
comercial,
offering
al
audio
su
post,
o
mais
define
my
solution
yourself
and
worst
of
all.
This
way
you
can't
benefits
from
the
dynamic
highline
to
build
your
own
assets.
They
say
well
optimize,
yo,
digo,
yo
in
joint
lead
and
time
machine.