►
Description
OpenShift at BestBuy Case Study
Case Study: OpenShift @ Best Buy
Jamil Ahmed (Best Buy Canada)
Taneem Ibrahim (Red Hat)
Andrew Block (Red Hat)
at OpenShift Commons Gathering 2019
at Red Hat Summit
B
C
Name
is
Andrew
Blanc
I'm,
a
senior
principal
consultant
with
Red
Hat
I
was
engaged
by
the
best
by
Canada
team
to
help
assess
their
open,
shipped
container
platform
environment,
but
also
work
with
them
to
get
through
the
holiday
season.
So
for
those
for
those
who
do
not
know,
Best
Buy
is
in
the
retail
industry,
and
the
retail
industry
has
seen
some
changes
over
the
course
in
the
last
decade
or
so.
When
you
think
about
how
customers
interact
with
retailers,
it
has
certainly
changed.
C
You
no
longer
are
going
into
brick-and-mortar
stores,
exclusively
you're
going
ahead
and
looking
at
new
avenues
on
how
to
work
with
the
different
retailers,
one
of
them
being
online
acquisitions,
you're
doing
the
shopping
online
you're
doing
your
purchasing
online
you're
doing
your
potentially
your
trading
in
your
bartering
online
and
then
also.
In
addition,
the
competition
is
exceedingly
expanding.
How
many
of
you
have
a
virtual
assistant
in
your
home
or
in
your
car,
Amazon
Alexa,
Cortana,
Google
home?
How
many
of
you
have
purchased
something
from
a
online
retailer
through
that
tool?
C
Raise
your
hand
the
competition
out.
There
is
no
longer
Sears
Penny's
Target,
it's
including
a
whole
whole
bunch
of
additional
retailers
out
there
and
they're
disrupting
the
competitive
landscape
and,
as
we've
seen
a
lot
of
the
brick-and-mortar
traditional
stores
have
struggled
or
in
worst
cases
have
gone
on.
A
business
I
mean
I,
look
at
I'm
from
Chicago
and
Sears
Roebuck
was,
you
know
massive.
They
owned
have
to
sit
nowadays.
A
Okay,
Best
Buy,
so
one
of
the
Canada's
largest
and
most
successful
retailers.
We
started
our
first
store
in
2002.
Now
it's
a
we
have
more
than
177
stores
and
we
have
traffic
like
250
million
traffic's
per
year
and
our
headquarter
is
in
Vancouver
BC.
We
have
around
200
people
in
our
corporate
office.
I
am
one
of
them.
It's.
C
A
So
we
have
lots
of
technical
challenges
at
the
beginning,
so
you
know
the
long
lead
times.
So
whenever
the
developer
is
asking
for
new
environment,
it
has
lots
of
dependencies
like
we
does.
We
do
the
CM
install
package.
It
has
lots
of
different
NC
packages
same
as
this,
so
they
request
environment
to
the
platform
team.
Then
we
have
the
platform.
A
King
goes
to
the
virtualization
team
for
the
VMS,
then
the
word
system
goes
to
the
network
team
for
the
IP,
DNS
and
other
things,
and
then
we
also
have
the
storage
team
and
the
crypto
team
for
SSL
Certificates.
So
it
takes
around
like
three
weeks
to
four
weeks
during
that
time,
so
the
developers
are
having
coffee
outside
in
the
lobby,
so
they're,
not
working
because
their
environment
is
in
progress.
Building.
A
Another
thing
is
like
more
of
the
manual
steps.
So
most
of
the
time,
the
production
environment
is
not
same
as
the
development
environment,
so
we
had
lots
of
incident
at
the
beginning,
so
they
are
pushing
something
that
is
working
on
the
dev
environment,
but
it
is
not
actually
happening
same
in
the
production.
A
Also
challenging
was
to
scale
up
the
environment
when
we
need
same
thing
again
manual
process,
so
we
have
to
estimate
ahead
of
the
time
what
the
pic
traffic
will
be
and
what
we
are
looking
for
to
help
us.
So
we
started
this
open
shift.
Our
journey
started
on
2016
and
17.
We
started
with
a
open,
shipped
origin
at
the
time
to
do
some
piace
proof-of-concept
talking
to
the
leadership
team,
also
a
development
team
that
okay,
we
are
planning
to
introduce
this
in
2017
or
18.
We
deployed
a
openshift
enterprise
2.5
in
the
production
successfully.
A
A
So
we
import
at
the
team,
so
they
don't
have
to
depend
on
other
teams
for
the
infrastructure,
improve
DevOps
principles,
more
pipelines
and
things
going
on
and
yeah.
You
can
guess
that
who
is
having
more
coffee
breaks
nowadays,
the
plot
some
people,
even
we
are
working
on
this.
We
still
have
to
go
through
those
holiday
seasons.
Lots
of
traffic
comes
in,
so
we
always
partner
with
our
reddit
experts,
so
Metheny
man
and
he
is
helping
us
so
I
will
ask
him
to
say
something
on
mph.
Thanks.
B
Jimmy
so
make
the
holidays
or
goes
as
mth
within
Best
Buy.
That's
the
timeframe
when
Best
Buy
gets
ready
for
the
critical
holiday
sales
period.
So
even
though
the
holiday
season
doesn't
start
quite
to
late
November
in
North
America,
the
preparation
for
the
uptick
in
traffic
store
traffic
online
traffic.
That
starts
around
mid
August.
So
that's
when
we
go
through
a
lot
of
load,
testing
performance
testing
regression
tests
to
make
sure
that
the
projected
traffic
that
we're
looking
for
is
actually
going
to
meet
the
demand
of
a
cluster.
B
So
as
part
of
that
as
a
Tam
I
also
perform
supportability
check
stress
test
check
to
make
sure
that
the
components
the
customer
is
using
is
are
on
par
with
what
supporting
matrix
allows
them.
So
the
main
critical
part
is
from
August
15
to
about.
First
of
all,
October
is
the
testing
period
and
October
1st
is
when
the
change
free
stakes
in
place.
So
once
change
Friesen
is
in
place.
B
Essentially,
you
can't
make
any
more
changes
to
your
code
base,
so
no
incremental
changes,
no
new
features
you're
only
allowed
to
make
changes
at
the
approval
of
your
senior
leadership.
If
that's
somehow
impacts
the
holiday
sales,
so
no
more
changes
any
any
issues
that
comes
across
during
that
time,
we
at
Red
Hat
work
very
closely.
B
Even
a
minor
issue
is
treated
as
a
severity
once
because
we
know
how
important
having
a
stable
server
at
cluster
is
important,
knew
the
holiday
season,
and
then
we
have
the
first
big
demand
date,
which
happens
right
at
Thanksgiving
during
during
the
fall
North
America,
and
then
we
have
the
Cyber
Monday,
the
following
Monday
and
Black
Friday
the
day
after
Thanksgiving.
During
this
time,
customer
has
access
to
you.
The
big
demand,
technical
manager,
service
and
peak
demand,
customer
success
manager
who
are
24
by
7
on-call
resources
so
anytime.
B
If
there
is
an
issue,
any
outage
that
happens,
customer
can
reach
out
to
us
directly
and
we
work
with
our
extensive
support
team
to
make
sure
everything
is
resolved
as
quickly
as
possible.
So
there
is
minimal
disruption
to
the
customer
success.
Then
we
have
the
next
three
critical
dates
for
holiday
period.
Is
the
Christmas
Eve,
the
Boxing
Day,
which
happens
the
day
after
Christmas,
and
then
you
have
the
New
Year's
Day,
and
the
same
protocol
applies
that
time.
Customer
has
access
to
the
peak
demand,
Technical,
Account
Manager
and
a
customer
success
manager,
and
they
were.
B
B
So
in
the
past,
before
we
had
open
shipping
place,
so
I
have
been
at
em
with
best
buy
for
eight
years
now.
So
I
have
seen
my
share
of
outages.
That
happened
during
the
holiday
season
and
and
and
no
matter
how
minor
the
outage
might
be.
The
overall
experience,
my
experience
always
goes
down
with
an
outage
and
when
you
have
customer
experience
that
goes
down
that
leads
to
lost
revenue
lost
sales.
So
it's
obviously
not
a
good
thing
and
we
have
long
queues
that
the
customer,
because
some
certain
features
aren't
working
because
we
couldn't
demand.
B
C
Thanks
to
name
maybe
around
the
September
October
time
frame,
Best
Buy,
Canada
engaged
with
red
hat,
consulting
to
assess
their
current
environment
and
then
to
actually
help
them
prepare
for
the
mth
season.
Now
I've
worked
with
a
number
of
different
customers
both
in
the
retail
space,
and
one
of
the
key
things
that
we
like
to
do
is
to
put
a
preparedness
plan
in
place
to
ensure
that
they're
gonna
have
success
through
their
critical
period.
You
know,
mph
is
probably
one
of
the
most,
if
not
the
most
important
period
for
Best
Buy
Canada.
C
We
did
some
initial
steps
for
just
assessing
their
current
architectures,
making
sure
that
each
of
the
environments
has
all
the
critical
patches
so
that
they
would
have
no
vulnerabilities
going
into
the
holiday
season
and
then
next,
what
we
ended
up
doing
is
to
start
putting
together
some
performance
tests,
Genevan
kind
of
started
to
talk
about
that
a
minute
or
two
ago.
But
we
wanted
to
assess
the
expected
traffic
that
we
were
going
to
see.
C
We
took
last
year's
the
2017
traffic
period,
went
ahead
and
assess
what
we
thought
would
be
the
estimated
amount
of
traffic
that
we're
going
to
expect
in
2018.
We
then
went
ahead
and
took
a
percentage
of
wiggle
room.
Basically,
we
said
okay
is,
we
know
about
expected
amount
of
traffic.
We
want
to
go
ahead
and
ensure
that
it
can
meet
the
demands
that,
let's
say,
140
150
percent.
C
If
we
can
ensure
that
our
services
can
meet
that
demand,
we're
gonna
feel
fairly
confident
that
even
if
we
meet
in
also
exceeded
our
expected
demands,
I
mean
I'm,
hoping
that
we
exceed
the
expected
demands.
That
means
more
people
are
purchasing
browsing
consuming
our
services.
That's
the
most
critical
and
success
criteria
for
the
business,
and
then,
when
we
ended
up
doing
is
from
that
we
went
ahead
and
determined
which
applications
which
underlying
infrastructure
we
needed
to
scale
up
to
meet
the
capacity.
C
C
In
addition,
we
also
looked
at
no
pot
auto-scaling
ways
to
you
know.
As
you
know,
a
traffic
demands
from
customers
as
soon
as
Black
Friday
hits
they're
gonna
want
to
go
ahead
and
start
purchasing.
We
want
to
make
sure
our
services
are
scaled
up
effectively
and
can
scale
dynamically
to
take
advantage
of
the
infrastructure
that
we
ended
up
deploying
now
from
a
customer
perspective.
What
is
the
holidays
really
like?
How
many
of
you
go
out?
C
You
know
who
live
here
in
North
America
go
out
on
Black
Friday,
raise
your
hand
how
much
fun
is
it
to
go
out
on
Black
Friday,
the
sarcasm
I'm
sure
what
the
Woo's
are
exceeding?
It
is
a
painful
experience
if
you're
gonna
go
ahead
and
take
advantage
of
the
most
critical
deals.
They're
gonna
be
camping
out
overnight
in
the
stores
I'm.
C
You
know
we're
from
the
northern
part
of
the
country
to
NIEM
you're,
lucky
you're
from
the
southern
part,
but
it's
cold
up
in
the
northwest
you
in
that
time
of
year,
you're
out
there
you're
cold.
You
want
to
just
get
into
the
store
as
soon
as
it
opens
beat
the
crowds
and
obviously
work
with
the
friendly
customer
staff
who
help
there
to
help
you,
but
it's
still
extremely
stressful
period.
C
I
personally
have
not
gone
out
and
done
the
but
the
Black
Friday
thing
just
not
my
thing,
but
for
those
of
you
who
happen
to
brave
the
stores.
Good
luck
from
an
open
ship
administrative
perspective,
we
didn't
really
have
the
craziness
that
all
the
customers
face.
What
did
you
think
Jamil
I
thought
was
pretty
pretty
calm,
yeah.
A
So
there's
this
peak
load
graph,
you
can
see
the
average
traffic
is
like
hundred
thousand
per
minute,
but
reading
mth
or
Black
Friday.
It
instantly
jumps
to
the
seven
times
of
ten
times
of
traffic,
so
we
have
to
put
those
auto-scaling
and
extra
resources
ahead
of
the
time
and
so
in
general,
the
request
comes
like
eleven
thousand
acres
per
second
and
openshift.
It
was
very
common
at
the
time,
no
outages
and
no
incidents
during
that
week
and
we
were
very
happy
with
that.
A
We
shared
our
learning
experience
to
this
journey
and
we
actually
started
with
few
applications.
Then,
after
this
journey
as
well,
we
invited
other
other
teams
to
get
in
and
during
that
time
we
made
some
community
environment
inside
our
organization
also,
and
he
helped
us
on
that
community.
For
all
these
best
practices.
C
Yep,
so
one
of
the
areas
I
also
focus
on
aside
from
the
actual
preparedness
and
delivery,
is
helping
organizations
build
their
community
and
that's
essential
when
you
look
to
adopt
openshift.
Is
you
want
to
build
a
community
around
OpenShift
to
share
learnings
across
the
entire
organization,
because
in
many
organizations,
I
work
with
they're
just
getting
into
containers
they're,
also
looking
to
see
how
they
can
optimize
their
usage
of
containers
and
building
that
community
allows
the
organization
to
scale
effectively?
You
don't
want
to
just
have
one
small
team
manage
everything
it
doesn't
scale?
C
Well,
so
what
we
ended
up
doing
is
we
started
to
work
with
the
best
bi
team
in
continue
to
build
on
their
internal
process
called
the
community
of
practice.
Community
of
practice
is
something
we
also
do
here
with
in
Red
Hat
as
well
and
I
am
the
co
manager
of
the
container
and
paths
community
of
practice
and
when
a
community
practice
really
is
meant
to
do
is
to
bring
together
thought
leaders
around
a
particular
area
in
space,
so
one
in
particular
container
and
pass
within
Red
Hat.
We
go
ahead
and
bring
these
experts.
C
Have
them
work
more
effectively
amongst
one
another
and
to
create
a
plan
to
help
share
and
build
out
their
community,
and
that's
really
he
when
adopting
open
ship.
That's
building
that
community
and
through
the
our
combined
work,
everyone
from
the
delivery
team
myself
to
to
name
on
the
Technical,
Account,
Manager
team,
obviously,
most
importantly
Jamaa,
you
know
who
was
able
to
actually
implement
it
within
the
organization
were
able
to
scale
effectively.
C
The
different
communities
that
were
part
of
and
the
containers
team
within
within
Best
Buy
are
part
of
a
number
of
Co
PS
that
Best
Buy
currently
has
ranging
from
the
DevOps
EOP
the
platform
on
infrastructure,
automation,
Co,
P,
the
operations
and
engineering
Co,
P
and
site
reliability.
Engineering
now
how
many
of
you
show
of
hands
that
I'm
very
I,
like
participation
in
our
presentations?
How
many
of
you
have
a
similar
program
within
your
organization?
C
It's
pretty
good!
How
many
of
you
are
looking
to
adopt
a
similar
program,
yeah
that
you
have
brick
wants
and
wishes,
but
just
haven't
had
a
chance
to
do
so.
Well,
I'm
gonna
be
around
all
week.
You
know
it's
gonna
be
around
it's
in
with
to
name
we
want
to
hear
about
you.
You
hear
your
experiences
and
hear
exactly
how
we
might
be
able
to
take
some
of
our
learnings
learnings
within
Red
Hat
we've
been
best
by
Canada
to
help
you
build
out
your
program.
So
from
that
we
also
it's
part
of
the
community.