►
From YouTube: ESPA Module - Engineering Tooling
Description
Vukasin (Vuk) Vukoje (Ecosystem WG) with Protocol Labs discusses engineering tooling and technological developments in the Enterprise Storage Provider Accelerator (ESPA) bootcamp week that took place in February 2022.
Data is growing at an incredible speed and much of this data is archived and/or simply lost by enterprises. Our program will accelerate net-new Enterprise Storage Providers into the ecosystem, using a Web3 protocol with an impressive incentive model called Filecoin.
Learn more at:
Sign-up: https://web3espa.io
Landing Page: https://m.fil.org/espa-bootcamp
Follow ESPA:
Twitter: https://twitter.com/web3ESPA
LinkedIn: https://www.linkedin.com/company/web3espa/
A
Today,
I'm
gonna
try
to
cover
some
stuff
that
was
not
covered
so
from
what
I
could
see.
It
was
mostly
very
deep,
like
in
the
details
of
mining,
I'm
gonna
try
to
zoom
out
and
try
to
like
picture
why
it
is
like
important
generally
for
us
as
a
society,
to
work
on
decentralized
search
rather
than
gaining
the
details
of
what
specifically
do
you
need
to
do
to
actually
be
a
storage
provider,
but
myself
I
spent
most
of
the
past
four
or
five
years
in
the
blockchain
space.
A
I
built
a
serp
that
was
a
development
tool
for
ethereum
developers.
Then
I
joined
cardano.
I
like
the
smart
contracts
and
tokens
was
there
for
a
year
and
then
I
joined
protocol
labs
to
help
with
unlocking
storage
for
billions
of
people
in
the
world.
A
Now
why
join
protocol
apps
is
specifically
to
solve
these
problems,
which
are
like
very
big
problems
today,
when
we
are
using
like
any
digital
application
like
instagram
or
like
anything
that
you
do
online
is
basically
is
basically
controlled
by
very
large
organizations
that
most
of
the
time
have
to
like
import
your
data
in
order
to
have
like
business
models
that
are
sustainable.
A
A
So
the
big
problems
are,
of
course,
that
we
have
no
control
on
the
app
us
and
we
cannot
control
where
the
data
is
going
to
go
so
like
when
I
save
a
picture
instagram
that
is
most
likely
going
to
be
sore
on
a
couple
of
regions.
I
have
no
clue
that
my
data
is
being
moved.
I
have
no
clue
that
the
algorithms
are
being
trained
on
top
of
the
data
and
so
on.
A
Also,
it's
not
clear
for
me
why
I'm
seeing
particular
things
so,
most
of
the
time
I'm
going
to
be
seeing
things
that
are
most
likely
that
I'm
gonna
click
on,
rather
than
things
that
I
would
like
to
see
and
do
we
kind
of
take
those
as
granted
today,
but
actually
those
apps
should
be
doing
what
we
wanna
have
them
do,
rather
than
what
is
better
for
instagram
and
the
other
big
tech
companies.
A
An
example
of
that
could
be,
for
example,
imagining
instagram
that,
instead
of
showing
you
like
pictures
of,
I
don't
know
nice
things
that
you're
most
likely
gonna
like
and
find
like
some
squirt
ads.
That
are
gonna,
be
like
very
similar
to
that.
I
might
wanna
see
like
things
that
are
calming
me
or
things
that
are
making
me
happy
and
so
on.
A
We
definitely
don't
see
that
content
near
on
instagram
or
on
the
other
apps
like
yeah
facebook
and
the
google
only
apps,
and
the
reason
for
that
is
that
we
have
no
control
over
the
data
that
we
are
actually
storing
on
on
those
applications.
And
the
main
reason
for
that
is
that
currently,
the
only
infrastructure
that
we
know
that
is
being
used
by
big
tech
is
centralized
infrastructure.
A
So,
like
everything,
is
behind
like
some
authentication
and
then
we
go
to
some
server
that
is
owned
by
a
big
company
and
so
on,
and
most
of
the
abstractions
that
we
have
around.
Our
data
are
owned
by
those
organizations
that
we
cannot
even
imagine
like
applications
that
are
not
focused
on
just
maximizing
the
focus
that
we
spend
on
those
applications.
A
We
are
trying
to
solve
those
issues.
The
government
is
trying
to
have
some
discussions
with
the
big
tech,
but
that
doesn't
go
so
well,
because
those
companies
have
so
much
leverage
right
now,
because,
if
facebook's
says
hey
sure,
we
want
to
fix
those,
but
like
those
are
almost
impossible
for
us
to
solve
on
the
infrastructure
layer.
So
we
would
need
to
like
turn.
Facebook
off
for
entire
europe,
then
the
discussion
becomes
much
higher.
A
A
Every
day
we
have
some
anti-monopoly
laws
that
are
kind
of
trying
to
do
something,
but
actually,
since
we
are
basically
using
only
one
platform
for
one
thing,
we
are
all
aware
that
those
don't
work
so
well
now
in
order
to
actually
get
off
big
tech
and
get
off
like
all
the
infrastructure
that
was
built
in
a
centralized
way.
We
need
to
rebuild
the
infrastructure
from
scratch.
A
Today
we
are
trying
just
to
do
like
the
first
step,
which
is,
let's
make
sure
that
some
computers
are
running
like
the
minimum,
which
is
ipfs
and
falcon,
which
is
required
for
other
folks
to
actually
build
applications
on
top
and
store
their
non-centralized
way.
A
But
it's
also
important
that
we
understand
that
currently,
developers
that
are
building
apps
have
no
choice
than
to
go
to
cloud
providers.
You
don't
have
a
choice
today
if
you
want
to
build
an
app
most
likely
you're
going
to
use
like
either
a
firebase
or
you're
going
to
use
some
other
development
tool
that,
at
the
end
of
the
day,
is
backed
by
some
big
cloud
provider
and
at
the
end,
that
data
is
going
to
be
stored
on
some
like
data
center.
A
So
what
we
need
to
do
first
is
we
need
to
like
change
the
paradigm.
We
need
to
change
the
problem
from
a
partner
where
we
are
looking
at
the
data
from
the
location
of
the
data,
which
is
what
we
are
doing
today.
A
So,
instead
of
looking
at
the
urls,
where
that
are
basically
saying
like
what
the
location
of
a
particular
file
is,
we
want
to
start
looking
at
the
content
and
when
we
start
doing
that,
then
we
unlock
like
the
possibility
for
us
to
get
off
those
those
platforms
that
are
basically
just
locking
our
data.
In
the
reason
for
that
is
because,
if
I'm
looking
at
the
content,
I
don't
anymore
need
to
like
address
a
server
that
is
owned
by
a
big
organization.
A
Yeah
other
than
that,
there
are
very
few
very
important,
like
distinct
things
that
we
can
distinguish
between,
like
big
tech
and
what
we're
trying
to
achieve
with
the
blockchain.
First
of
all,
as
I
mentioned,
the
content
addressing,
but
secondly,
we
are
trying
to
build
the
ecosystem
here,
and
you
can
see
from
protocol
labs
that
we
are
trying
to
help
as
much
as
possible
to
build
an
ecosystem.
We
are
not
trying
to
build
things
that
we
want
to
have
the
community
build.
A
A
We
just
wanted
to
have
a
way
for
us
to
have
an
impact
in
the
nfd
space
and
in
fact
that
team
is
already
spinning
off
protocol
apps.
So
that's
not
protocol
labs
anymore.
That's
going
to
be
a
team
that
is
independent
that
can
hire
whoever
they
want
and
can
have
a
completely
independent
budgets
from
protocol
labs
and
also
so
strategy
and
so
on,
and
the
most
important
one
is
that
we
want
to
have
that
common
infrastructure
rather
than
infrastructure
that
is
owned
by
legal
entities.
So
the
falcon
infrastructure
is
not
owned
by
anyone.
A
Everyone
has
small
pieces,
but
at
the
end
of
the
day,
since
you're
addressing
content
by
the
content
hash,
that
content
is
not
owned
by
anyone,
many
nodes
of
the
network
will
be
able
to
actually
give
you
back
that
content.
So,
at
the
end
of
the
day,
if
I
as
a
user,
if
I'm
trying
to
get
to
a
content
that
I
own,
I'm
gonna
get
that
content
back
without
having
to
ask
any
legal
entity
for
that,
nor
having
my
data
a
lot
behind
some
big
company
so
yeah.
A
In
order
to
solve
those,
we
have
several
segments
that
that
we
need
to
like
cover.
First
of
all,
we
want
to
have
like
the
retrieval
networks,
so
when
you're
storing
something
on
falcon,
it's
going
to
be
on
falcon,
but
that
is
not
going
to
be
retrieved
right
away.
So,
most
of
the
time,
if
you're
trying
to
access
their
that
distorted
falcon,
that
there
is
going
to
be
coming
from
ipfs
and
there
are
ways
in
how
we
are
like
caching,
things
on
ipfs,
rather
than
directly
pulling
them
from
icon.
A
You're
not
going
to
be
building
data
from
falcon
right
away
as
a
developer,
because
that
takes
time
takes
resources
on
the
miner
and
so
on,
of
course,
falcon
falcon
other
than
being
a
massive
storage
network.
A
It's
also
an
incentive
layer
for
all
the
data
that
is
stored
on
mpfs,
with
smart
contracts
coming
out
soon,
we
are
going
to
see
an
explosion
of
very
creative
use
cases
that
allow
us
to
build
the
applications
on
ipfs
and
falcon
that
were
not
possible
before,
and
we
have
bridges
to
blockchains
that
allow
us
to
bridge
the
value
of
all
the
current
blockchains
that
we
know
like
near
ethereum
and
so
on
to
the
value
of
the
falcon
token.
A
With
that
unlock
potential
financial
tools
that
allow
maybe
search
providers
to
get
better
access
to
liquidity,
or
maybe
to
incentivize
the
storage
of
a
particular
data
set,
and
we
also
have
something
that
is
the
beginning
of
networks
on
top
of
falcon
that
are
actually
networks
that
are
supplementing
pipeline.
A
That's
estuary
and
textile,
so
estuary
is
currently
on
the
unknown
that
you
can
also
run,
but
ashrae
eventually
is
most
likely
going
to
become
a
network
of
nodes
that
are
there
to
actually
batch
the
storage
of
the
surge
on
the
falcon
network
and
on
the
other
hand,
you
have
textile
that
is
there
to
make
sure
that,
when
you're,
storing
particular
data
on
falcon,
you
can
also
attach
particular
information
on
ethereum
and
have
like
that
connection
between
ethereum
and
and
falcon
other
than
that.
A
A
One
of
them
is
webtrader
search,
which
is
basically
a
javascript
library
that
allows
developers
to
through
to
adjust
script
library
to
add
files
on
both
iphones
falcon
web3d
storage
is
backed
by
estuary,
which
is
basically
doing
the
orchestration
of
the
storage
deals
on
the
falcon
network,
but
it's
also
pinning
the
data
on
ipfs
and
with
that
making
it
readily
available
to
the
folks
that
want
to
consume
that
there
nft,
the
surge,
something
that
are
already
mentioned
is
doing
a
very
similar
job.
A
Although
how
you're
interacting
with
nft
to
storage,
is
a
bit
different.
Your
focus
on
that
particular
file
that
you
want
to
add,
rather
than
having
a
javascript
library
that
is
adding
those
you
are
interacting,
either
through
a
api
or
you're
interacting
through
a
ui
that
that
you're,
using
as
an
artist,
for
example,
if
we
zoom
out
a
bit.
A
What
is
happening
here
is
that
we
have
like
those
storage
helpers
or
like
storage,
steel
orchestrators
that
are
actually
the
ones
in
charge
of
making
the
storage
stills
on
the
palco
network,
and
they
are
both
pinning
data
on
ipfs,
but
they
are
also
doing
the
orchestration.
Now.
Those
orchestrator
have
like
a
list
of
minors
that
are
reputable
that
are
good
manners.
A
Your
objective
should
be
to
get
on
those
lists,
because
that
will
mean
that
you're
gonna
get
more
traction,
because
those
folks
will
be
like
sending
more
verified
storage
details
to
you
yeah
and
now
a
bit
more
about
tools
for
search
providers.
This
is
specifically
something
that
I'm
working
hands-on
with
the
team
that
I'm
incubating
at
protocol
labs.
A
The
first
tool
that
we
built
is
filgram,
which
is
basically
explorer
for
storage
providers.
So
you
have
like
all
the
search
providers
in
the
falcon
ecosystem
that
are
listed
here,
and
those
storage
providers
can
redeem
the
manners
that
they
they
own
and
attach
them
to
the
search
profile
that
they
have.
Let
me,
let
me
just
show
you
in
a
bit.
A
Yeah,
so
you
can
see
here
yeah
by
the
way
like
this
is
cutting
edge.
This
is
not
even
out
the
dark
team,
so.
A
Yeah,
so
basically
what
I'm
gonna
do
is
I'm
gonna
go
to
my
dashboard
and
I
can
see
that
I
have
two
search
providers
attached
with
the
my
keys
that
I
have
attached
here.
So
I
have
multiple
keys
that
I
have
added
and
I
have
multiple
storage
providers.
So
what
I
want
to
do
is
I
wanna,
for
example,
change
change
and
maybe
the
copy
on
the
storage
provider.
A
A
And
yeah
I'm
gonna
say
vk.
This
is
my
slack
handle
on
the
falcon
slack.
A
And
you
can
see
that
some
information
is
available
here
for
people
to
see,
but
also
a
url
to
define.
My
landing
page
is
also
available
here.
The
next
thing
that
that
I'm
gonna
show
you
is
like
the
storage
deals
that
are
being
made
by
particular
storage
clients
with
storage
miners.
Let
me
actually
get
one
that
has
a
bunch
of
storage
deals.
A
Is
my
someone
from
the
room
as
it's
from
the
us.
You
can
see
that
this
particular
manner
is
not
attached
to
a
storage
provider
so
that
storage
provider
should
claim
this
miner.
But
you
can
also
see
that
this
miner
received
verified
storage
deal
and
that
is
mostly
receiving
verified
storage
skills
in
the
past
day
or
so
as
well.
You
can
see
that
this
search
provider
is
asking
for
0.0004
fill
for
non-verified
storage
skills,
so
these
are
non-verified
storages.
A
A
The
next
thing
that
we
have
built
is
fileman
dot
io,
which
is
basically
a
platform
that
allows
you
to
start
mining
without
having
to
own
your
collateral.
So
you
would
put
down
some
collateral.
A
That
is
basically
one
tenth
of
what
you
what
you
wanna
use
for
mining
and
we
would
be
giving
you
a
lot
of
allowance
that
you
can
use.
The
important
piece
is
that
you're
not
owning
fill
ever
the
field
is
owned
by
people
that
are
staking
in
that
liquidity
pool
you're
just
using
that
that
leverage
and
you're
mining
it
and
you're
receiving
block
rewards
every
24
hours.
A
It's
also
important
to
note
that
you're
not
being
vested
in
that
case
you're
receiving
the
entire
reward
that
your
minor
made
for
the
past
24
hours,
which
is
different
from
what
the
current
situation
is
on
the
falcon
network,
because
when
you
mine
a
block
you're
wasted
for
six
months.
So
basically
you
need
to
wait
six
months
until
you
get
like
the
entire
reward.
A
A
You
can
see
here
that
in
the
case
of
infrastructure
sealing,
I
don't
know
10
tips
a
day
in
a
year
you
would
have
made
half
a
million
usd
yeah
with
phil
would
feel
at
what's
17
today.
A
A
Maybe
in
a
month
from
now
now
I
want
to
spend
a
bit
of
time
discussing
what
we
think
that
the
web3
data
center
is
going
to
be,
and
that
should
help
you
also
architecture
data
center,
and
it
would
also
be
a
good
point
of
discussion
for
the
q
a
so
currently.
A
We
have
just
the
storage
network
and
you
could
imagine
that
that
would
be
falcon
and
we
could
have
also
some
computing
network
which
could
be
like
live
viewer
or
it
could
be
render
or
something
that
is
using
a
lot
of
compute
now.
A
Those
two
are
pretty
separate
right
now,
like
those
are
different
networks
with
different
tokens
with
very
little
ways
of
interacting,
and
if
I
were
to
compute
something
on
on
live
pr
in
this
case.
What
I
would
need
to
do
is
I
would
need
to
like
most
likely
retrieve
data
from
s3,
and
would
that
be
a
lot
of
fees
for
retrieving
the
data?
A
Then
I
would
need
to
do
some
computing
on
the
node
of
lipiier
and
then
I
would
need
to
be
taking
that
data
and
sending
it
back
somewhere,
most
likely
s3
again,
so
most
of
most
of
the
fees
are
mainly
going
to
the
cloud
providers
in
that
case
because,
like
the
miners
of
the
live
peer
protocol
are
subsidized
and
here
they're
also
getting
rewards,
but
the
fees
for
the
cloud
provider
cannot
be
subsidized.
Those
are
paid
by
the
users
so
like
the
value
prop
of
live
peer.
A
In
that
particular
case,
it's
is
much
lower
than
it
could
possibly
be,
but
imagine
actually
retrieving
the
data
directly
from
python
and
ipfs
rather
than
going
to
as3
and
getting
data
from
from
cloud
providers.
A
So
in
that
case
we
would
need
something
like
estuary,
which
is
the
node
that
I
mentioned
you
that
azure
is
building
which
would
be
sync
on
your
data
center
and
you
would
be
leveraging
estuary
for
retrieving
some
particular
cid
from
the
storage
network
and
then
putting
that
available
for
the
compute
network
in
this
case
either
render
or
live
peer,
and
that
compute
network
would
do
like
all
the
chart
charging
and
make
sure
that
the
miner
gets
reward.
A
In
that
case
you
and
then
the
output
should
be
stored
on
the
same
node
again,
which
is
through
asteroid
to
falcon
and
ipfs
again
and
at
the
end
of
the
day.
That's
all
going
to
be
running
in
the
same
local
network,
which
is
the
most
interesting
part,
because
we
are
not
anymore
going
out
to
the
internet
and
spending
a
bunch
of
bandwidth
that
we're
paying
for.
Instead,
all
the
computation
is
happening
on
the
local
network.
A
The
reason
for
that
is
because,
if
I
am
using
the
cids
rather
than
the
location
itself,
I'm
not
going
out
to
the
cloud
provider
and
asking
for
a
particular
file,
rather
I'm
asking
for
a
particular
cid
and
most
likely
that
cid
is
going
to
be
on
my
infrastructure
if
I'm
computing,
similar
jobs
and
at
the
end
of
the
day,
what's
going
to
happen,
is
that
that
file
is
going
to
be
pinned
on
ipfs
on
that
particular
local
network,
and
only
once
the
data
is
going
to
be
going
out
of
the
data
center
and
very
little
bandwidth
fees
would
need
to
be
paid
for
that.
A
But
how
does
that
specifically
look
like
in
the
data
center?
So
we
can
imagine
a
data
center
with
and
hosts
and
we
can
imagine
the
falcon
storage
network
running
on
each
of
those
those
hosts.
But
realistically
it's
not
gonna
be
the
falcon
storage.
It's
also
gonna
be
falcon
ceiling,
so
you
could
imagine
like
the
triangle
being
ceiling
and
maybe
like
the
circle
being
approved,
while
the
rest
is
storage,
for
example.
A
Now
we
also
want
to
have
like
those
computing
networks
on
some
of
the
costs,
and
we
want
to
also
have
estuary
on
some
of
the
surge
nodes,
because
the
data
from
the
computing
nodes
needs
to
be
somehow
written
to
those.
So
all
of
that
would
need
to
be
happening.
The
data
center,
and
you
would
need
to
be
like
somehow
running
that
on
your
infrastructure,
so
we
are
trying
to
get
closer
to
that.
A
The
first,
of
course,
important
piece
is
to
have
you
guys
more
exposed
to,
like
other
folks
like
render
ipr
and
the
other
networks
and
give
you
an
opportunity
to
tinker
with
those
networks,
but
in
the
future
we'll
be
working
more
on
actually
connecting
those
and
making
products
that
actually
help
your
guests
are
without
having
to
worry
about
those
specific
networks,
so
yeah.
I
think
with
that,
I'm
slowly
wrapping
up
now.
A
The
last
thing
I
want
to
cover
is
why
we
are
trying
to
do
all
of
this,
because
basically
we
are
reinventing
the
way
that
they
are
stored
globally,
and
there
are
very
good
reasons
for
that.
A
First
of
all,
we
need
to
like
bring
back
the
to
the
users,
the
users
right
now
for
some
stupid
reasons,
because
how
history
went
are
not
owning
their
data
and
somehow
we
are
okay
with
that,
but
we
are
not,
but
we
have
no
no
choice
and
and
yeah
like
that,
if
you
think
more
deeply
about
it,
it's
a
very
stupid
situation
to
be
in
and
it's
solvable
and
you
have
tools
like
ipfs
and
falcon
that
can
actually
solve
this.
A
Of
course,
we
need
to
put
some
effort
in
because
there
is
a
lot
of
friction
on
the
other
side,
which
is
big
tech
companies
pouring
money
into
like
development
tools
that
make
the
development
experience
much
easier
if
you're
building
centralized
apps.
Secondly,
we
want
to
make
sure
that
we
leverage
the
current
infrastructure
that
we
have
the
best
we
can
so
fiber
in
general
is
very
expensive,
especially
fiber,
that
is
going
out
of
the
data
center.
A
Currently,
in
the
data
center,
we
are
seeing
a
lot
of
innovation
from
melanox
with
a
very
fast
interconnects
locally,
but
we
are
not
innovating
that
much
when
it's
data
centered
to
data
center
communication,
and
that
is
going
to
be
always
expensive,
because
that
requires
a
lot
of
digging
and
a
lot
of
cables
going
through
oceans
and
stuff
and,
most
importantly,
when
we
get
to
a
point
where,
where
we
have
networks
that
are
actually
rewarding
people
for
contributing
to
those
networks,
rather
than
transactions
for
paying
for
storage,
like
what
cloud
providers
are
doing
today,
we
are
getting
to
a
point
where
we
can
colonize
both
storage,
but
also
in
the
future
compute,
and
when
we
start
commoditizing
compute.
A
We
are
going
to
get
to
a
point
where
we
at
least
have
a
chance
of
solving
some
of
the
most
challenging
problems
that
we
have
like
cancer,
research,
dna
precision,
medicine
and
stuff,
like
that.
Those
are
not
possible.
Today.
If
you
were
to
store
like
your
dna
on
a
cloud
provider
that
would
probably
cost
you
like
more
than
your
earning.
A
A
It
is
possible
and
we
should
be
like
pushing
more
and
more
storage
on
the
network
that
is
kind
of
unlocking
those
use
cases,
and
then
we
can
go
out
and
approach
those
folks
that
are
actually
working
on
those
use
cases
and
give
them
also
the
compute
and
figure
out
through
which
network
we
are
going
to
give
give
them
the
compute,
where
that's
going
to
be
there
on
top
of
the
falcon
network
or
an
existing
network
that
exists
separately.
A
And
finally,
we
also
have
the
chance
to
rethink
the
economic
models
that
we
currently
have.
So,
instead
of
thinking
about
paying
for
the
services
with
our
attention
like
instagram
and
facebook,
we
could
start
thinking
about
being
paid
for
actually
generating
the
data
and
providing
the
data
to
that
service,
which
is
possible
with
the
current
system
that
we're
building
with
falcon.
Because
you
could
imagine
at
some
point
verified
deals
not
being
readily
available
for
storage
providers.