►
From YouTube: Fast Deploys - Dagster Community Day - Dec 2022
Description
In this demo, Elementl engineer Shalabh Chaturvedi provides an overview of a recent improvements to Dagster Cloud Serverless: Fast Deploys: By using prebuilt Docker images, Dagster Cloud now deploys changes radically faster than it used to by bypassing the image rebuild. Dependencies get managed seamlessly.
A
A
A
Typically,
this
could
take
anywhere
from
three
minutes
up
for
five
minutes,
sometimes
of
time
that
you
would
spend
waiting
to
see
the
effect
of
your
change
in
Dexter
Cloud.
We
build
a
new
Docker
image,
upload
it
to
the
extra
Cloud
where
a
new
container
is
provisioned
and
the
new
code
is
run
from
which
we
extract
the
new
asset
graph.
A
A
A
We
should
we
see
that
the
actual
the
new
asset
graphs
available
I
can
actually
just
refresh
this
page
and
see
my
new
acid
right
there.
This
is
ready
to
run,
and
meanwhile,
if
I
go
back,
Docker
based
push,
it
is
still
building
the
docker
image
after
which
it
will
upload
it,
and
then
it
takes
a
lot
longer.
So,
let's
not
wait
for
that.
Instead,
I'm
going
to
show
you
I'm
going
to
talk
a
little
bit
about
how
this
works,
so
how
do
fast
deploys
work?
A
The
key
idea
behind
this
optimization
is
that
when
you
make
a
code
change
instead
of
rebuilding
and
deploying
an
entire
Docker
image,
we
can
rebuild
and
deploy
only
a
smaller
slice
that
contains
all
of
the
code
that
has
changed.
For
this.
We
use
something
called
PEX
is
a
tool
that
given
a
set
of
python
code
or
python
packages,
will
bundle
them
into
a
single
file
called
the
PEX
file.
We
actually
use
two
PEX
files,
one
for
your
source
and
one
for
your
dependencies.
A
Once
these
PEX
files
are
uploaded
onto
dixter
Cloud,
we
run
them
on.
We
still
run
them
on
top
of
Docker
on
a
standard
base
image.
We
have
a
set
of
four
standard
base
images
for
python
versions,
3.7
through
3.10.
It
is
possible
for
you
to
build
your
own
Docker
image
and
upload
it,
and
it
can
be
used
as
a
base
image
to
run
these
PEX
files,
so
fast
deploys
are
Now
the
default
for
all
new
signups.
If
you
already
have
a
setup
with
Dexter
serverless,
we
give
you.