►
From YouTube: Filecoin Mining Workshop - Filecoin Mining: A Deep Dive
Description
Miners assemble! Join @Magik6k for the second Space Race workshop - Filecoin Mining: A Deep Dive. The most comprehensive overview of mining to date!
Join Space Race;
https://spacerace.filecoin.io/
And learn more about filecoin at:
filecoin.io
A
Hi
everyone,
a
very
warm
welcome,
come
on
in
take
a
seat,
maybe
you're
in
a
seat
already,
that's
totally
fine
too.
Maybe
you've
got
a
standing
desk.
Maybe
that's
your
vibe.
That's
great!
Also
we're
just
gonna
give
it
a
minute
or
so
to
let
other
people
join
in
the
meantime,
please
let
us
know
where
you're
joining
from.
I
am
coming
to
you
today
from
glasgow
in
scotland
and
yeah.
I
know
our
team
are
across
the
world
as
well.
A
We've
got
someone
from
dc,
I'm
from
norcal,
which
I
think
is.
Northern
california,
I'm
very
jealous
the
weather.
Here
is
definitely
not
as
nice
derek
from
dallas
hello
at
benjamin
from
denmark,
you're
in
my
part
of
the
world,
a
warm
a
warm
welcome.
We've
got
austin
texas.
A
Okay,
all
right!
Let's,
let's
get
this
on
our
way,
so
a
very
warm
welcome
to
the
second
of
our
foulcoin
mining
workshops.
Today
we
are
doing
falcon
mining
and
deep
dive.
We
it's
a
really
exciting
time
in
space
race,
we've
got
345
miners
across
the
world
who
have
onboarded
76
pebbites
the
network.
Just
it's
just
incredible
like
we
are
so
excited.
A
We
hope
you're,
super
excited
and-
and
the
purpose
of
today
is
to
like
really
get
into
the
kind
of
mechanics
of
file
coin
mining
and
hear
from
one
of
our
very
best.
So
it
gives
me
immense
pleasure
to
welcome
falcone
engineer
magic
who
is
going
to
lead
this
workshop
over
to
you
magic.
B
Hello,
everyone
yeah.
I
want
to
really
start
with
explaining
some
car
concepts
behind
falcon
and
mining
yeah
we'll
go
through
some
of
them.
So
everyone
understands
what
I
am
talking
about:
yeah
we
start
with
power
and
falca
and
minor
power,
just
basically
like
you
could
have
winning
a
block
is
based
on
the
amount
of
proven
storage,
and
that
is
slightly
different
from
other
blockchains,
where
power
is
your
hash
rate
or
state
fans.
B
B
Which
will
go
into
more
detail
in
a
bit?
It
supports
32
and
64
gigabyte
sector
sizes
just
also
relevant
a
bit
later.
Next,
we
go
to
actors
which
are
a
bit
like
ethereum,
smart
contracts,.
B
Every
actor
has
a
balanced,
nonscope
state,
an
address
the
key
addresses,
so
the
one
prefixed
with
t1
or
d3
are.
B
Yeah
the
difference
in
mainnet
is
going
to
be
that
all
addresses
are
going
to
start
with
the
letter
f
instead
of
t,
so
that's
how
we
will
distinguish
between
real
addresses
and
the
less
real
ones
or
well.
This
doesn't
interest
us
yeah.
Next,
we
go
a
bit
more
into
specific
actors.
First,
one
is
the
power
actor
which
is
responsible
for
just
keeping
the
network
power
table,
and
that
is
mostly
just
interacting
with
minor
actors
you,
as
miners,
usually
don't
interact
with
it
directly.
B
It
handles
all
storage.
Events
verifies
your
proof
structure
tracks
your
sectors
over
time.
Just
ties
your
mining
compression
to
the
rest
of
the
network.
B
You
will
be
sending
a
lot
of
messages
to
it,
so
we
voted
up
yeah.
It
can
be
controlled
from
multiple
keys,
but
on
the
topic
of
keys,
yeah
supports
two
key
types:
6p
and
vls,
and
as
miners
you
have
to
use
a
pls
key
as
the
main
or
worker
key
that
you
use
to
create
blocks.
This
is
because
bls
keys
have
the
interesting
property
that
there
is
only
one
valid
signature
for
one
input
message
and
we
use
that
to
derive
some
of
the
randomness
into
network.
B
B
That's
just
ceiling
or
running
starts
just
how
you
gain
power,
and
then
you
need
to
prove
that
you
store
those
sectors
over
time,
which
is
how
you
keep
your
power,
and
that
is
the
actual
block
mining,
which
is
how
you
get
the
network
to
move
forward
and
also
get
block
rewards,
which
makes
it
all
worth
it.
B
Look
at
the
like
higher
level
architecture,
no
questions
so
far
by
the
way,
if
anyone
has
any
questions,
feel
free
to
ask
them.
So
we
go
because
there
is
a
lot
of
context.
Switching
here,
yeah,
fundamentally,
we
have
three
note
tapes
as
miners
you
will
likely
be
using
all
of
them
on
the
top.
You
have
the
demon
or
what
we
call
the
blockchain
node.
This
is
what
this
talking
to
the
network.
B
The
lotus
miner
is
what
is
handling
all
mining
related
tasks
just
connects
to
connects
these
stores
to
the
network
and
that's
basically
everything
you're
interested
in
and
then
you
have
lotus
workers
which
are
an
extension
of
the
main
lotus
miner
process,
just
yeah.
It
allows
you
to
add
more
resources
to
it.
It
can
be
run
on.
Multiple
machines
allows
you
to
build
much
larger
mining
clusters
and
we'll
focus
on
the
lattice
miner,
mostly
for
this
stack,
because
it's
well
where
all
the
default.
B
B
B
B
B
So
you
have
to
do
less
work
to
accept
more
deals
so
and
hopefully
get
paid
more
for
less
work.
Just
probably
what
you
want
to
do,
yeah,
also,
if
nothing
capacity
sectors
can
be
upgraded
into
sectors
with
deals.
B
Upgrading
a
sector
means
that
the
initial
pledge
doesn't
have
to
be
paid
again
or
is
reduced
depending
on
the
network
conditions.
It
usually
won't
have
to
be
paid
yeah.
Next,
from
those
two
paths
we
go
into
the
common
sync
path.
B
B
Then
we
go
get
to
the
first
very
fun
step
where
we
do
the
replication,
which,
with
sdr,
is
a
single
threaded
process.
It
requires
the
very
minimum
64
gigs
of
ram.
B
You
probably
want
more
and
then
some
swap
memory
using
more
memory
just
makes
it
a
bit
faster.
The
process
is
inherently
single
threaded,
so
you
cannot
accelerate
it
by
trying
markers
at
it
or
a
gpu.
It
doesn't
help
at
all.
C
B
B
And
you
are
able
to
discard
most
of
that
after
this
actor
is
fully
sealed.
The
whole
process
takes
about
four
hours
in
a
zen
two
and
these
empty
based
cpus
and
we're
getting
some
optimizations
soon.
Hopefully,
so
it
should
get
somewhat
faster,
we'll
see
how
much
then
from
pre-commit
one
we
go
into
pre-committee
where,
where
they
happy
and
credited
sectors
now
we
have
to
build
a
few
special
numerical
trees
over
the
data.
This
step
can
be
run
on
gps
society
parallel.
B
It
writes
another
three
times:
detector
size
of
data
worth
worth:
data
on
disk,
which
is
about
100
gigabytes
for
a
32gb
sector.
It
doesn't
care,
it
doesn't
require
too
much
memory
and
it
can
be
run
on
gpu.
It
takes
about
30
minutes
on
a
2080
ti,
so
you
usually
want
to
be
a
bottleneck
in
most
cases
after
we've
computed
the
pre-comment.
B
C
B
B
B
It
may
get.
Optimized
we'll
see.
Yeah
the
the
whole
process
takes
about
an
hour
with
a
2080
di
for
a
32
gig
sector.
B
B
C
C
Do
yeah.
C
B
It
only
really
has
two
jobs
just
to
keep
data
around
and
when
computation
sign
up.
Since
I
get
relatively
simple
tasks,
so
this
is
the
architecture
diagram
for,
for
for
it
it's
more
tricky
than
it
sounds
so
yeah,
let's,
let's
unpack.
C
B
Both
the
main
miner,
node
and
worker
nodes
can
have
multiple
paths
for
workers
that
supported
since
very
recently,
I
think
only
in
0.57
those
are
divided
into
two
types.
B
So
you
will
probably
want
to
have
separate
paths
for
for
those
two
to
start
types.
Then
we
go
into
remove
bus,
so
storage
can
be
local
or
remote.
Each
node
can
have
a
different
set
of
local
paths
and
when
I
need
note,
I
mean
either
a
miner
or
a
worker.
B
B
Yeah,
so
going
back,
sectors
need
to
be
moved
between
nodes,
and
this
is
when
remote
paths
come
in
handy
each
local
path
and
by
local
I
mean
above
that
and
node
you
can
access
locally.
So
it's
just
a
local
directory.
B
Each
local
path
in
the
system
is
exposed
by
its
node
through
http,
and
this
allows
nodes
to
transfer
sectors
between
themselves.
B
It's
also
worth
noting
that
us
can
be
shared
between
nodes
using
short
file
systems
such
as
nfs
ceph
or
any
other
technology.
That
does
that,
and
this
makes
it
so
that
transfer
don't
have
to
happen
over
http.
B
B
B
Each
worker
will
access
its
its
local
storage
and
it
can
also
pull
things
from
remote
storage
fast
into
its
focal
storage
bus
yeah
again,
the
doctor's
minor
process
embeds
worker.
So
technically
it's
not
necessary
to
run
the
lotus
worker
process.
If
you
only
have
one
machine,
there
are
still
some
cases
where
that
can
be
a
good
idea,
but
usually
you
won't
have
to
with
just
one
machine
and
now
the
fun
part
get
to
scheduling.
B
B
It's
really
hard
because
it
needs
to
balance
a
lot
of
things
we
we
want
to
support
many.
We
have
to
support
a
diverse
range
of
setups
at
many
different
scales,
and
we
kind
of
we
kind
of
just
require
everyone
to
build
their
data
centers
in
the
same
way
with
the
same
parts.
B
It
doesn't
work
so
so
that
we
have
to
support
everyone.
The
scheduling
strategy
it
has
a
few
parts.
B
C
B
Is
much
more
complicated
than
it
sounds
yeah,
so
we
use
the
concept
of
resource
windows
mostly
to
prevent
resource
starvation.
So
when
you
have
a
lot
of
small
tasks
and
a
few
big
tasks,
you
could
be
scheduling
this
stream
of
small
tasks
and
that
would
prevent
the
bigger
task
from
ever
running.
B
B
B
And
they
do
that
by
moving
tasks
from
those
assigned
windows
to
the
preparing
window
and
then
start
preparing
for
an
intellectual
task,
so
preparing
usually
means
just
fetching
the
sector
from
other
workers,
just
making
sure
it's
locally
available
yeah
when
the
assigned
window
from
which
we
pull
task
into
the
parameter
when
the
assigned
window
get
this
assembled.
Yet
we
send
it
back
to
the
scheduler
as
a
new
open
window
to
get
a
smart
task
when
tasks
in
the
preparing
window
are
ready
for
processing.
So
we
fetch
detector
or
it's
already
here.
B
Okay,
the
task
will
get
moved
to
the
running
window
where
it
is
actually
executed.
So
we
actually.
This
is
where
we
actually
run
the
bigger
test,
like
pre-commit
one,
two
and
everything
else,
using
lots
of
resources
for
a
decently
long.
C
B
B
It
doesn't
care
if
you
set
it
to
low
at
all,
just
send
everything
to
you
and
you
have
to
somehow
survive
that
or
not
okay.
So
next
there
will
be
some
improvements
coming
soon.
Ish
the
current
project
isn't
perfect,
we'll
be
working
on
a
number
of
things,
make
it
somewhat
better
yeah.
We
are
also
very,
very
open
for
any
ideas,
so
just
send
her
our
way,
if
you
think
you
know
how
to
make
this
better
without
too
much
effort.
B
Okay:
next,
we
have
proving
storage
the
next
decently
big
thing
we
have
to
do
as
miners.
B
Searches
prevent
through
window
post
or
we
do
proof
of
storage
proof
space
time
all
sectors
are
proven
every
24
hours
unless
they
are
fully
or
expired,
in
which
case
we
probably
can't
prove
them.
Anyways.
B
Split
the
24
hour,
so-called
proving
period
into
48
deadlines.
Each
deadline
is
30
minutes
that
probably
came
from
dividing
24
hours
by
48.
B
B
B
B
B
Then
you
enter
the
deadline,
the
deadline,
open
ebook
and
from
from
that
time,
you
have
30
minutes
to
submit
the
window
post
message
to
detain
if
you,
after
30
minutes,
miss
the
deadline,
close
ebook.
B
B
Sector
related
fault
types,
you
have
declared
faults
and
skipped
faults,
skipped
post
faults,
declared
faults,
may
pay
a
smaller
penalty
compared
to
skipped
post
falls,
so
you
want
to
declare
that
you
are
not
able
to
prove
your
storage
in
advance.
B
The
difference
is
pretty
big
from
what
I
remember
sectors
that
are
faulty
through
either.
Full
tape
can
be
faulty
for
14
days
and
after
14
days
they
will
be
permanently
terminated
unless
they
are
recovered
from
the
recovery
mechanism.
B
B
Yeah,
like
faults,
you
have
to
declare
recoveries
35
minutes
or
before
35
minutes
before
the
deadline
opens
at
the
latest.
B
Deadline
in
which
the
sector
has
and
after
you
declare
that
recovery
and
you
do
submit
the
window
post
for
that
sector,
you
will
just
recover
the
power
for
for
it.
B
You
want
recover
the
fee.
You
had
to
pay
for
full
think
on
that
sector.
So
don't
just
default.
It's
expensive,
yeah,
the
next,
pretty
major
thing
that
you
do
as
a
minor.
Yes,
my
books.
This
is
where
you
actually
get
your
blog
rewards
and
get
paid
for
everything
you
do.
C
B
B
If
we
did
win,
we
start
completing
another
type
of
proof
called
the
winning
post
winning
post.
This
just
approves
space
time
on
a
single
random
sector
and.
B
So
this
way
you
lying
about
your
storage,
the
only
thing
it
does
is
it
slows
down
the
network
somewhat
and
to
slow
down
the
network.
Significantly,
you
have
to
remove
a
huge
portion
of
network
power
was
a
costly,
very,
very
significant
amount
of
funds.
Just
because
seeing
sectors
is
very
expensive.
B
Yeah,
after
completing
winning
post,
we
select
messages
based
on
gas
premiums
and
some
other
factors,
such
as
ticket
quality,
in
a
way
which,
up
to
my
discuss,
reward
and
that's
much
more
complicated
than
another
blockchain,
because
in
other
blockchains
you
generally
have
one
block
at
one
height
and
falcon.
B
B
B
This
is
the
select
mining
base
step
from
before.
After
the
blocks
have
arrived,
we
check
if
we
won.
B
If
we
did
win,
we
compute
the
winning
posts,
we
put
a
snark
which
has
to
be
done
quickly
also
for
winning
post.
You
really
want
a
gpu
because
it
has
to
be
done
quickly
like
it
should
be
taking
10,
maybe
15
seconds.
If
it
takes
longer,
you
need
to
optimize
something
or
get
better
hardware
yeah,
so
you
compute
this
arc.
Hopefully
in
less
than
15
seconds,
it
can
take
a
bit
longer,
but
it
gets
pretty
tight.
B
Yeah,
so
that's
it
for
mining.
Now
we
can
enter
the
time
yeah.
We
can
either
go
to
note
setup
or
answer
some
questions,
so
maybe
we'll
do
and
maybe
we'll
go
quickly
for
denoted,
because
it
may
have
some
interesting
things:
yeah
creating
a
minor
note.
B
You
usually
want
to
set
the
sector
size
for
my
net.
It
will
be
either
32
or
64
gigabytes.
Also
something
I
mentioned
that
64
gigabyte
sectors.
The
only
difference
is
that
they
use
basically
twice
the
resources
for
most
sitting
steps,
but
the
benefit
is
that
you
send
two
times
less
messages
to
the
chain
and
that
can
save
you
a
lot
of
cost
and
maintenance
on
gas
fees,
and
we
don't
know
how
the
how
they
will
look
so,
maybe
maybe
worth
supporting
64
gig
sectors.
B
B
B
Yeah,
there
are
also
some
other
flags
on
the
internet
command
like
no
local
storage,
which
just
makes
the
miner
not
have
any
local
storage
which
currently,
you
will
have
to
just
have
under
storage
stuff
manually,
because
the
lotus
miner
process
has
to
have
at
least
one
local
storage
path.
Unfortunately,
this
should
be
changing
soon
and
you
will
be
able
to
run
and
answer
post
challenges
from
workers,
which
will
be
very
neat
because
you
will
will
not
have
to
have
any
storage
in
your
local
lotus.
B
Miner
note
yeah
the
next
step
after
you
run
the
initialize
command.
You
will
have
to
fetch
some
hundreds
of
gigabytes
of
snark
graph
parameter
files.
B
B
With
that
you
put
that
number
for
the
maxing
sector
for
deals,
and
then
you
set
the
max
ceiling
sectors
for
something
on
the
tower
like
six
or
eight,
because
you
don't
like
you,
want
to
have
some
space
for
sectors
with
deals,
always
especially
in
space
race,
where.
B
Ceiling
deals
is
one
of
the
requirements
then
magnet
yeah
also
gives
you
yeah
like
rejecting
people's
deals.
It's
not
what
you
want
to
do,
so
you
set
the
for
deals.
Number
higher
next.
Is
the
weight
deals
delay
it's
the
time.
B
B
B
There
is
the
storage
section
which
is
just
used
to
configure
the
built-in
worker,
and
then
you
have
some
fee
config
which,
just
let's
you
configure
how
much
you
want
to
pay
for
which
kind
of
message,
but
it's
if,
if
gas
fees
get
very
high,
it
might
might
not
be
worth
putting
pre-comments
and
comments
in
china
so
with
that
they
will
just.
C
B
Instead
of
getting
pushed
to
the
chain
yeah
next,
we.
B
B
So
if
the
network
fees
get
very
high,
you
still
have
to
post,
but
you
don't
want
to
you:
don't
necessarily
want
to
pay
high
fees
for
pre-comment
and
commit
messages,
and
the
problem
is
that
if
you
are
sending
both
of
those
message,
types
from
one
key,
the
pre-comment
and
comment
messages
with
low
fees
sets
on
them
can
block.
Just
because
you
need
to
have
intubate
messages
on
chain
with
continuous
answers.
B
For
a
bit
of
funds
and
cassies
next,
attaching
storage,
bus,
yeah,
every
miner
and
worker
kind
of
multiple
stretch
paths
they
can
be
attached
without
this,
without
restarting
anything
with
just
the
storage
attach
command,
we
also
specify
weight
which
makes
it
more
likely
to
be
used
yeah.
This
is
just
pretty
simple
configuration.
We
don't
have
a
command
to
detach
a
storage
buff,
yet
we
plan
to
implement
it,
but
I
don't
know
if
that's
going
to
happen
soon
or
not
yeah
everything
else.
B
There
are
a
lot
of
topics
that
I
didn't
go
much
into,
that
are
still
manipulated
markets
and
data
transfers
could
probably
get
another
hour
of
talking
yeah.
There
are
topics
that
have
to
back
up
and
out
no
redundancy
which
we
don't
really
support,
yet
that.
B
We
should
go
into
and
then
there's
method,
selection
and
all
the
gas
rated
fun
times,
which
could
probably
also
use
like
another
hour
or
two
of
talking
about
yeah.
Instead
of
that,
I
can
get
questions
from
people.
A
Awesome,
thank
you
very,
very
much
magic.
That
was
incredible
and
I
think
the
most
comprehensive
kind
of
deep
dive
that
we've
done
into
falcoid
mining
so
far.
So
thank
you
so
much
for
sharing
your
expertise.
You
do
have
questions.
I
think
you've
answered
some
of
these
throughout
your
presentation,
but
if
you're
happy
to
let's
just
run
through
them
anyway
and
let's
start
with
meatballs
question
meatball
is
the
name
I
know
you're
one
of
the
community
champions
on
space
race
last
week.
So
congratulations
for
that.
A
Meatball's
question
is
related
to
the
lotus
miner
set
up.
Can
we
get
more
clarification
on
what
the
expected
sale,
duration,
max
weight
deal,
sectors
max,
sealing
sectors,
max
sealing
sectors
for
deals
and
weight
deals?
Delay
are
in
the
lotus
miner
config.tomol
file
and
what
would
be
some
suggested
settings
for
them
in
single
minor
and
multi-worker
setups.
C
A
No
worries
okay,
so
we
had
a
question
in
the
chat
from
meatball,
which
was
this.
Is
this
is
a
hard
one
to
say
out
loud?
Can
we
get
more
clarification
of
what
the
expected
sale,
duration,
max
weight
deal,
sectors
max
sealing
sectors,
max
sailing
sectors
for
deals
and
weight
deals?
Delay
are
in
the
lotus
miner
config.tommel
file
and
what
would
be
some
suggested
settings
for
them
in
single
miner
and
multi-worker
setups.
B
Yeah,
so
that's
basically
what
I've
gone
into
here,
mmd
config
yeah,
just
very
quickly
again!
That's
how
much!
How
long
do
you
expect
to
see
incorporation
to
take?
You
should
set
it
to
something
24
hours
for
a
small
miner,
mike's
radio
sectors,
maxine
sectors
just
divide
your
squad,
storage
by
about
500
gigabytes,
each.
C
A
B
Some
parts
of
the
config
can
be
changed
dynamically
for
the
api.
Some
cannot,
we
will
be
very
likely,
will
be
swapping
the
whole
config
sub
system
for
something
that's
property
based,
and
that
allows
reloading
every
configuration
like
element
without
having
to
restart
your
notes,
because
it's
very
bad.
We
also
try
to
implement
something
which
allows
you
to
restart
or
upgrade
your
notes
without
losing
progress
on.
A
B
I
am
not
sure
if
it's
exposed
in
the
storage
desk
my
experience
from
experimenting
with
it
and
finding
a
lot
of
deals
is
that
it
does
not
do
from
what
I
know
the
like:
dual
style.
Duration
was
recently
increased,
so
the
deals
you're
getting
from
the
bot,
not
sure.
What's
the
current
number
yes
ian
might
know.
C
B
Now
so
you're
definitely
safe
setting
it
to
24
hours.
You
are
maybe
safe
setting
it
to
48
hours,
I'm
not
sure,
probably.
A
Yeah,
I
think
ian
actually
popped
a
comment
in
there
below
that
says.
The
deal
bot
expects
deals
to
be
done
within
48
hours
from
proposal
you
can
think
of
it
as
a
testing
for
a
certain
quality
of
service,
so
that
that
adds
some
additional
context
to
the
answer.
Okay,
magic.
Another
question
here
from
benjamin
is
using
one
shared
nfs
documented
anywhere.
B
A
Awesome,
thank
you
magic.
Let
me
see
a
question
here
from
youtube
from
august.
How
will
miners
at
first
obtain
the
initial
file
coin
necessary
for
mining
magic?
I
know
the
answer
to
this
one.
If
you're
happy
for
me
to
take
it,
we
have
a
falcon
faucet,
which
we
can
link
to
you.
A
In
fact,
we
can
link
here
below
which
will
give
you
the
kind
of
initial
pledge
collateral
that
you
need
for
experimenting
on
the
test
nets,
and
one
of
the
team
will
link
it
here
below
for
you
august,
okay,
I
think
we
have
time
for
maybe
one
more
question:
okay,
this
question's
from
hyun.
What
are
some
conditions
that
cause
deadlocking
in
the
scheduler,
sometimes
running
ceiling,
jobs,
command,
results
in
halfing
process
and
breaks
the
scheduler.
B
There
shouldn't
be
any
if
that
happens,
to
you,
paying
us,
send
us
a
back
report
on
an
issue.
The
ceiling
issue
template
at
github.
B
A
Awesome,
thank
you.
Well,
I'm
afraid.
That's
all
we've
got
time
for
today.
Folks,
if
you
have
any
additional
questions,
please
head
over
to
the
falcon
slack,
which
we'll
link
here
in
the
chat,
a
huge
thank
you
to
magic
for
taking
the
time
to
share
his
expertise
with
us
and
to
all
of
you
for
joining
us
coming
up
tomorrow,
we've
got
a
live
ama
with
the
falcon
team
and
a
crypto
week.
One
workshop
with
juan,
where
he'll
be
talking
about
the
recently
published
engineering
falcons
economy
report.