►
From YouTube: Data Engineer Intersnship - Chris and Radovan
Description
Chris and Radovan talking about DBT sharing for Salesforce data
A
Yeah
great
next
session
for
us
for
DVD,
shorting,
okay,
Chris,
so
actually
from
my
side,
I
checked
the
application
frequency
stitch
for
Salesforce
and,
as
we
expected
each
six
hours,
we
refresh
the
data
and
the
next
option
for
us
is
to
analyze
the
models
and
Target
them,
at
least
at
all
of
them,
to
hear
the
scope
of
the
product
so
Chris.
How
is
going
with
this
part.
B
It's
going,
okay,
I've
got.
B
I've
got
the
the
dag
up
and
running
locally
I
just
need
to
do
some
more
testing
and
figuring
out
exactly
what.
A
B
A
We
can
do
it
together
if
you
want
just
to
have
the
scope
of
the
project
I
mean
we
can
put
it
here
like
just
so.
We
can
get
enough
time
today
to
have
outcome
like
list
of
models
we
want
to,
let's
say
analyze,
yeah.
A
B
A
A
B
A
legacy
model
so
and
to
dig
into
to
get
some
of
these.
B
B
B
Hey
great
so
we'll
go
if
I
want
to
mess,
and
then
these
ones
I
think
are
some
I
think
some
of
these
nose
pipelines.
So
where
would
they
be
workspace
product.
B
B
I've
created
a
dbt6,
hourly,
dag,
okay
and
also.
A
B
A
A
A
I'm
thinking
to
do
all
the
things
inside
the
BBT
modeling
like
if
you
want
to
let's
say
transport,
something
from
incremental
to
full
or
sorry
from
Full
to
incremental.
If
you
want
to
split
something,
Optimus
I
think
that's
kind
of
DVD
sharding
to
put
everything
else
in
place,
and
the
next
issue
is
to
create
a
deck.
If
you
go
there,
just
go
back
to
the
issue
actually
and.
A
Go
to
Epic
and
you'll
see
an
epic,
so
maybe
it
will
be
good
now
at
this
moment,
because
here
in
just
my
vision,
Maybe
I'm
Wrong,
of
course
the
DBT
sharding
will
do
everything
regarding
DBT
and
inside
DVT
Deep
dive.
That
creation
is
a
separate
one.
If
you
go
to
Epic,
yeah
cdbt
duck
duck
creation
and
it
depends
of
Liberty
sharding.
B
A
A
A
True,
okay!
Next,
if
you
have
time
just
just
copy
paste
it
there
and
reset
these
chains
and
anyway
about
models,
do
you
think
we
have
something
more
than
about
packs
the
measures
and
how
it's
going?
I?
Don't
know
that
part
of
the
system
so
I'm
asking
you
because
of
that.
B
A
A
A
B
A
Actually
that
that
is
what
we
need
to
put
inside
the
list,
then,
from
my
point,
the
best
option
for
this
meeting
is:
if
your
outcome
is
full
set
and
full
scope
of
the
project,
and
then
we
should
Define
the
next
steps
like
okay,
let's
go
and
convert
it
to
incremental
things
like
that.
So
actually
this
beam,
CRM
and
parked.
A
B
B
Same
I'm,
pretty
sure,
I'm
and
I,
don't
think
I.
Think
incremental
is
really
the
large
large
tables
like
if
this
is
a
few
thousand
rows
which
I
think
it
is.
B
Then
a
full
refresh
would
would
be.
A
B
A
B
I
mean
possibly
perhaps
CRM
opportunity,
88
seconds
running
out
four
times
a
day.
It's
still
it's
still
pretty
inconsequential,
but
yeah.
A
A
Yeah,
let's
list
them
first
I
mean
except
this
CRM
and
then
serum
opportunity
do
we
have
any
any
kind
of
dimensional
effects,
because
we
need
to
treat
them
differently
and
probably
change
the
logic
there.
Even
we
keep
everything
like
full
refresh,
but
then
it
said
if
you
speed
up
the
let's
say,
loading
frequency
from
one
day
to
six
hours
or
something
how
to
deal
with
with
dips
and
effects.
Okay.
This
is
a
good
exercise
for
us,
because
this
is
fairly
small
light.
B
A
A
B
B
A
A
A
A
Said
about
this
workspace
sales
opportunity,
except
it's
a
legacy,
so
we
can
ignore
them
right
right.
Yes,.
B
A
B
A
B
B
A
A
B
Yes,
you
know
yeah,
oh
the
yeah,
that's
that's
the
great
thing
about
opening
things
in
numbers
like
I
would
normally,
but
but
it's
automatically
when
you
copy
and
paste
something
for
it.
It's
it's
got
markdown.
It's.
A
B
B
A
A
B
A
A
Okay,
so
actually
what
I
see
here?
We
identify
the
models
and
the
scope
for
our
product.
Definitely
the
second
one.
We
need
to
tug
them
with
what
you
say,
maybe
maybe
make
sense
to
tag
them
with
Salesforce
and
the
the
dog
name.
The
dog
name
will
be
six
hours
right,
let's
say
as.
A
B
Yes,
yes,
see,
I
I
did
I
went
through
and
I
had
sfdc
I
think
DBT,
SF,
DVT,
Salesforce,
six
hourly
or
something
like
that.
But
then
I
thought
well.
What,
if
you
wanted
to,
why
not
make
it
General
like
if
there's.
A
Anything
else
any
other
mortgages
more
generic,
because
I
would
say
we
need
to
create
a
smart,
because
if
you
put
sticks
early,
if
you
change
it
to
12
hour,
you
need
to
replace
or
rename
everything.
So,
let's
call
it
like
one
target
Salesforce
like
right
or
sfdc,
whatever.
Second
one
will
be
dog
sells
for
something,
because
we
will
call
that
something.
But
inside
that
you
will
Define
the
scheduled
time
right
and
if
you
change
the
schedule
time,
you
don't
need
to
rename
something,
because
it
has
always
been
sync
like
more
General
yeah,
exactly
yeah.
So.
B
I've
got
every
six
hour,
late,
Monday
to
Saturday,
and
then
I've
got
including
the
tag.
Six
hourly.
A
Yep
so,
instead
of
instead
of
call
type
six
hour
that
the
dog
I
mean
call
Doug
like
ssdc,
the
DBT,
like
you
know
what
I
mean
because
then
yeah.
A
We
our
goal
is
to
go
to
six
hours,
but
always
happen
well
decreased
or
increases.
So
it
will
not
be
six
hours
anymore
and
let's
say
you
keep
that
name
six
hours
and
you
have
scheduled
to
four
hours.
So
so
it's
completely
messy
right.
So
in
that
case,
let's
let's
go.
Let's
invent
a
good
name
for
for
tax
and
diagram
is
not
so
important
easily,
but
I
would
say
one
one
target
is
Salesforce
asset
or
ssdc,
and
second
tag
will
be
something
like.
A
A
You
have
a
product
type,
it's
Salesforce
or
sfdc
I'm.
Not
sure.
Second
tag
should
be
something
regarding
like
to
to
point
it
out
that
this
is
a
separate
bunch
of
jobs.
Tomorrow
you
can
have
another
sales
force,
but
in
a
different
dog
like
once
per
day.
So
if
you
combine
to
to
text
you're
very
flexible
I'm
speaking
because
of
my
previous
experience,
how
it's
going
right
all.
A
We
have
something
in
a
prayer
company
called
provider
provider
in
Salesforce
is
our
case,
and
you
have
various
type
of
data
like
these
data
are
transformed
once
per
day,
these
data
transfer
once
per
hour
even
at
the
same
provider.
So
you
can
imagine
to
be
more
flexible.
You
have
Salesforce
stack
on
all
jobs
or
all
models
regarding
Salesforce,
but
you
can
put
it
in
a
separate
ducts
and
you
need
one
more
tag
here
right,
something.
B
A
Then,
and
instead
of
six
hourly,
you
can
call
it,
you
can
call
it
the
Salesforce
underscore
deep,
DBT
or
underscore
sorry
motivity,
Doug
hourly
without
six
thousand
just
say
our
or
something
like
that.
B
A
B
B
A
A
A
B
A
B
A
B
A
I
want
to
find
the
example
how
we
run
Ducks
daily,
something
the
big
deal
around
yeah
yeah
exclude
to
give
them
I.
Think
if
you
put
the
white
space,
it
will
be
sufficient
here.
We
need
to
check
that
part
but
yeah.
For
now.
We
are
in
good
practice,
because
we
have
only
one
thing:
two
two,
let's
say
replace
yeah
see,
exclude
tag.
A
A
B
A
A
Makes
sense,
let's
see
then
for
us,
then
now
we
scope
the
project
we
need.
We
let's
say
agreed
on
the
ties.
Social
combined,
Salesforce,
plus
six
hours
you
should
investigate.
Is
it
possible
to
run
using
two
tags
exclude
include
things
like
that
yeah
and
also
the
next
step
for
us
is
to
analyze
a
bit
until
next
meeting
I
will
do
the
same
parallel
with
you
before
next
session.
A
What
we
need
to
optimize
you
nice,
to
bring
the
times
of
the
execution,
so
we
will
see
okay,
especially
when
it
comes
to
the
Imagine
effects,
how
to
treat
that
this
part
is
not
a
problem,
because
it's
fairly
humble
in
execution,
so
I
would
say
what
do
you
think
next
week,
next
device?
This
is
okay
for
you
to
have
a
session
again.
B
A
A
A
Usually
we
have
a
separate
development
environment
for
airflow
and
for
SEMA
in
in
in
Snowflake,
but
because
you
call
Monte
Carlo
Library
python
Library
here
and
you
execute
the
command,
it
will
go
to
Monte
Carlo
production,
our
montevo
production
and
you
will
be
alerted.
So
that's
the
catch,
so
maybe
yeah
forsake
to
stay
safe,
just
delete
it
or
I.