►
Description
Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.
Porting Python to WebAssembly - Christian Heimes, Red Hat
In 2021 CPython, the default implementation of the Python interpreter written in C, did not have any support for WebAssembly out of the box. A year later Python 3.11 will be released with built-in support for WASM platforms Emscripten and WASI. The Python community is using WASM for more and more projects, like Pyodide, PyScript, and JupyterLite.
A
Hello
Detroit
welcome
to
my
pre-recorded
talk
about
how
I
ported
python
to
webassembly
it's
an
honor
to
present
this
topic
to
you
today
and
thank
you
very
much
Liam
for
inviting
me
and
giving
me
the
chance
to
talk
about
Python
and
webassembly
hi
I'm,
Christian,
hymas,
I'm,
a
python
call
developer
and
principal
software
engineer
for
Red
Hat
in
the
past.
I,
usually
work
on
circulated
topics
for
python,
but
a
year
ago,
webassembly
piqued
my
interest
and
I
started
to
dig
into
webassembly
a
yoga.
A
The
base
implementation
of
python
just
kind
of
works
with
that
script.
So
we
have
a
very
major
and
portable
code
base.
We
use
C11
without
many
fancy
features
because
we
target
a
variety
of
compilers.
We
use
autoconf
and
make
files
and
if
you
even
extensive
test
Suite,
but
some
of
the
limitations
made
it
a
bit
more
harder
and
also
some
problems.
A
novel
system.
For
example,
we
require
P
threats
which
are
mostly
not
available.
A
But
with
some
efforts
and
also
help
from
Ethan
Smith
last
year,
November
2021,
we
got
the
main
branch
of
python
compiled
to
webassembly
and
running
that,
and
the
default
HTML
in
the
face
of
end
script
in
the
browser.
This
required
lots
of
hackery
and
tooling
and
scripts
and
shulker.
We
wrote
to
just
get
it
bootstrapped,
while
even
have
that
already
working
I
was
still
facing
with
some
problems.
A
With
my
initiative,
you
see
here
a
screenshot
of
a
web
console
that
shows
that
there's
a
vital
python
error
so
because
they
can't
import
the
encodings
package
or
model.
This
is
the
first
python
code
that
gets
imported
by
python,
so
that
was
very
exciting.
For
me,
the
first
time
I
got
python
working
in
the
browser,
at
least
to
a
point
where
it
needed
the
standard
Library,
where
ethernet
already
figured
out
how
to
bundle
the
standard
library
and
package
it
as
a
visual
file
system
and
contribute
that
app
distributed
to
the
browser.
A
When
we
have
these
things
detected,
we
can
have
a
very
minimal
core
to
bootstrap
the
import
system,
so
import
lip
is
Python's
import
system,
the
power,
the
import
statement,
but
it's
written
in
Python
and
we
don't
have
anything
to
import
the
import
system.
So
we
compile
the
python
code
to
bytecode
inject
the
byte,
go
into
a
header
file
and
then
just
load,
the
bytecode
compiler
to
C
code
and
the
next
step.
When
we
have
the
import
system
working,
we
can
create
a
bootstrap
interpreter
that
can
do
a
bit
more.
A
Once
we
have
that
done,
we
can
compile
the
actual
python
interpreter
with
the
static
built-in
models
and
then
use
the
patented
meter
to
compile
the
shared
extension
models
or
having
web
assembly
support
and
having
cross-compiling
working
again.
I
had
to
change
several
aspects.
So
what
we
do,
for
example,
I,
was
introducing
new
webassembly
cross-compiling
targets,
so
we
had
like
1132
M,
scripting
and
Wazi,
and
for
M
script
and
I'll
introduce
the
idea
of
different
like
targets
of
flavors,
because
for
one
we
wanted
to
talk
about
browsers,
but
for
running
the
test.
A
We
also
wanted
to
have
raw
fault
system
access
from
node,
so
there
are
like
different
ways
and
targets
to
compile
python
alternative
option
to
specify
and
use
a
build
python
interpreter.
So
in
order
to
cross
compile,
we
first
have
to
compile
a
python
operator
for
the
current
platform
and
then
use
that
to
bootstrap
the
freezing
of
the
import
lip
and
the
Deep
Frozen
files.
A
A
This
is
not
completely
done
in
311,
but
probably
done
for
312,
because
we
also
want
to
get
rid
of
setup
pi,
and
this
two
tilts
in
the
core
they've
also
improvements
for
conflict,
cache
to
just
speed
up
development
and
some
fixes
for
v-path
and
out
of
three
builds.
So
we
can
use
the
same
check
out
to
build
both
the
bolt
pattern
interpreter
and
the
final
web,
something
else
while
we're
working
on
that.
We
were
also
collaborating
with
the
piodight
team.
A
The
pilot
is
an
existing
working,
stable
distribution
of
python
for
the
web
browser
they
have
everything
figured
out,
but
they
also
had
to
run,
contribute
and
keep
lots
of
patches.
They
have
like
a
dozen
Downstream
patches
to
work
around
the
same
problems
we're
having
and
slowly.
We
are
migrated
and
upstreamed
several
of
these
patches
into
C
python
or
replace
them
by
better
efforts
like
instead
of
having
a
the
heckish
pi
config
H
patches
used
a
autocon
feature
called
conflict
site.
A
Next
thing,
when
we
had
everything
like
working
more
or
less,
we
wanted
to
make
sure
that
our
tests
were
passing
and
for
that
I
used
note
with
the
raw
false
system
access,
because
I
couldn't
figure
out
how
to
run
the
test
in
the
browser
and
would
note
it
was
more
akin
to
things.
I
do
normally
running
things
on
the
command
line,
so
for
each
other
telling
tests
or
crashing
tests-
and
there
was
a
failing,
crushing
tests.
I
had
to
check.
Is
this
cost
by
missing
or
unsupported
API?
There's
some
wrong
assumption
in
the
test?
A
A
But
we
also
used
sub
processes
for
our
internal
test
system,
so
regression
test
in
Python
we're
using
sub
process
for
isolation
and
for
running
tests
in
parallel
for
that
Ethan
Implement
a
host
Runner.
So
you
can
use
the
build
partner
printer
to
drive
the
test
system.
That
would
then
spawn
new
node.js
processes
for
every
test
case.
A
There
are
also
some
invalid
assumptions
that
no
longer
hold
true
for
M
script
like
test
the
steam.
If
they're
running
with
effective
user,
ID
0
so
root,
the
test
will
also
have
capsu's
admin
to
have
additional
like
Privileges
and
do
think
that
normal
user
can't
do
in
the
system
or
that
we
can
read
Arc
Value
zero,
so
read.
The
webassembly
file
itself
is
not
accessible
having
UTF
eight
non-nut
f8
files
or
inaccessible
files,
also
not
supported
by
m
scripton
or
calling
as
fstat
on
pipe
file
descriptors.
A
A
This
happened
because
one
of
the
test
models
had
like
a
invalid
function
signature.
So
it
didn't
accept
one
of
the
arguments
the
by
default.
If
you
remodel
you
get
a
reference
to
the
model,
as
you
can
do
any
additional
things
on
the
on
the
model
or
freeing
the
model,
but
the
Zone
info
implementation.
Just
except
no
arguments
such
as
white.
This
is
normally
not
a
problem
for
apis
like
Linux
or
Windows,
because
missing
arguments
or
additional
arguments
just
passed
on
registers
or
on
the
stack
and
just
ignores
by
the
function.
A
I
also
ran
an
interesting
bucks
in
M
scripting,
and
also
the
way
how
to
fix
suggest.
This
box
was
a
very
interesting
approach
because
I
had
to
rewrite
tests
or
implement
the
reproducer
in
C
code
and
the
fix
is
usually
involved,
modifying
a
JavaScript
layer
that
looks
a
bit
like
Cisco
Interceptor,
internal
code,
yeah,
interesting
and
so
here's
a
list
of
bugs
and
we're
going
through.
All
the
bugs
I
found
I'll
put
the
slides
up.
A
You
can
follow
any
of
the
bugs
if
you're
interested
yourself
also
contributed
several
improvements,
Jam
script
and
like
having
sqlite
port
and
M
script,
build
environment,
several
pixel
for
wasn't,
64.
and
since
beginning
of
this
month,
so
September
we
have
all
python
tests,
passing
on
wisdom,
64.2
and
several
other
fixes
and
by
April
2022.
A
We
finally
got
all
tests
passing
and
you
see
here
we're
still
skipping
like
92
tests
is
a
mostly
Network
related
tests,
because
networking
doesn't
work
like
in
normal
environments
here,
because
browsers
also
tightly
secured
and
sandboxed.
So
you
can't
open
raw
TCP
sockets,
and
this
is
unmodified.
C
python,
311,
Source
codes,
so
very
cool.
At
this
point,
Brad
and
I
were
considering
to
move
the
webassembly
and
script
into
tier
three
there's
a
mini
concept.
We
also
introduced,
and
this
year
a
different
level
of
support
for
environments
like
CPU,
architectures
and
operating
systems.
A
A
I
also
implemented
things
like
container
images
with
the
sdks
and
a
another
host
hosted
by
Microsoft.
The
pre-install
SDK
is
just
to
test
things
and
finally,
a
new
automation,
script,
which
made
it
very,
very
simple
to
compile
python.
So
if
you
run
this
script
in
main
or
in
311.1,
it's
not
going
to
be
in
three
eleven
zero.
It
will
first
tell
you
how
to
install
the
sdks
and
gives
you
some
tips
and
point
you
to
the
right
documentation.
A
And
then
you
have
everything
installed,
it
will
configure
and
compile
a
build
pattern.
Configure
and
compile
python
for
the
browser
run,
a
local
web
server
and
then
open
the
right
files
in
your
browser
and
just
give
you
a
prompt-
and
this
also
implemented
for
other
targets
like
M
script,
with
node
or
Wazi,
and
last
thing
I
currently
ran
like
on
my
own,
like
unofficial,
builds
and
also
smoke
tests
for
m-strip
and
SDK
latest
version
tip
of
tree
up
screen
and
for
Wazi.
A
A
It
turns
to
be
that
most
of
my
work
for
M
script
and
all
the
prepared
python
code
were
still
several
other
things
that
were
missing,
like
lots
of
features
from
the
socket
API
and
implemented.
There's
no
P
thread
and
those
P
thread
stops
well.
M
scripting
provides
stops
for
p
thread
apis
in
a
user
API,
no
Doc
syscall
and
some
other
restrictions.
A
Thankfully,
signal
stall
Labs
has
written
an
artificial
layer
of
Library
called
wazex
which
provides
steps
for
most
of
these
apis
and
like
with
them.
Scripting
I
also
run
into
problems
and
bugs
with
while
the
SDK
and
wasn't
time
to
remove
development
and
again
some
links.
If
you're
looking
for
the
map,
yeah
after
I
started
to
understand
how
amazing
works
and
how
vazex
Works
I
came
to
the
conclusion
that
was
hop
us
a
lot
to
bootstrap
and
start
the
Wazi
support,
but
wasn't
said
some
downside.
A
A
A
So
there
are
different
things
that
are
going
on
the
first
person
who
actually
adopted
my
C
pattern.
Upstream
work
was
Trey
and
he's
running
a
a
paste
bin
where
you
can
just
copy
and
paste
python
code
and
then
have
the
code
run
on
your
system.
We've
got
that
cool,
and
this
is
also
something
that
we
want
to
include
in
the
future
in
the
C
python
documentation.
So
they
have
executable
documentation,
examples
and
the
the
python
world,
but.
A
Pull
outs
so
how
commonly
the
system
is
structured
and
how
I
envisioned
they
will
work
on
the
Futures
on
a
very
low
level,
we
will
have
basic
support
for
Wazi
and
M
script
in
C
python,
but
since
we
lack
a
good
understanding
and
also
the
resources
and
the
core
developer
team,
lots
of
additional
work
will
be
provided
by
piodite.
Pilot
will
like
have
the
installer
will
have
packages
provided
we'll
have
a
glue
layer
to
the
JavaScript
API
and
talk
about
that.
A
There
will
be
efforts
like
running
jupyter
notebooks
like
Pi
script,
Pi
gain
numpy
other
things
well
for
Wazi.
We
are
not
sure
yet
because
we're
very
new-
and
there
is
no
like
production
or
python
Wazi,
because
there's
lots
of
things
to
do
so.
For
example,
we
have
not
figured
out
how
to
do
proper
deployment
and
distribution
of
python
and
Wazi
I've
been
playing
around
with
wiser
and
was
the
F
VFS
to
create,
like
single
file.
Distributions
socket
supports,
does
not
work
yet
correctly.
Also
facing
some
issue.
There
wasn't
time.
A
One
other
thing
that
I
hope
that
webassembly
may
help
us
in
the
future
to
get
out
of
the
Python
binary
extension
health.
So
if
you
have
python
extensions
with
binary
code
like
C
code,
Fortran,
coach,
C,
plus
plus
code,
whatever
they
have
to
be
compiled
for
a
specific
combination
of
CPU
platform
and
python
version,
but
maybe
in
the
future
we
could
actually
just
compile
it
to
webassembly,
have
a
web
assembly
runtime
embedded
in
python
as
an
extension,
and
then
only
have
one
file
to
distribute
the
other
things
from
M
script
and
browsers.
A
That
may
help
us
to
run
python
on
these
platforms.
For
example,
encrypt
doesn't
have
a
stable
API
for
a
pile
diet
if
they
distribute
Python
and
extensions,
they
have
to
make
sure
that
every
extension
is
compiled
with
the
same
version,
otherwise
will
just
crash
or
fail.
Debugging
is
also
tricky,
especially
for
core
developers
to
like
see
hackers
and
they
use
like
GDP
or
other
local
debuggers.
That
does
not
work
good.
At
the
moment,
CC
for
us
devtools
in
Chrome,
they
don't
give
the
same
experience
and
the
same
readable
information.
A
Compile
time
checked
for
this
invalid
function,
pointer,
Cask
or
went
from
a
mismatch
would
also
help
us
a
lot
and
there's
some
effort.
Equaling
Chrome,
to
improve
at
least
error
reporting
here,
while
the
SDK
the
same
problem,
there's
an
option
to
run
wasn't
time
to
provide
dwarf
ebook
symbol.
That
features
currently
also
broken,
then
a
glimping
I'm
sorry
I
mean
linking
would
help
us
a
lot
to
distribute
and
add
more
python
extensions
and
some
tooling,
like
amp
Builders
or
the
M
script.
A
Import
system
to
create
distributions
for
extensions
like
that
lab
vzip
2
will
help
us
too,
and
maybe
having
stops
for
p
threat
and
all
the
missing
features
in
Wazi
sck
may
be
helpful,
but
not
just
that.
So
we
don't.
We
also
want
to
help
the
the
community
I
think
one
thing
that,
where
python
could
help
you
really
well,
is
use
python
as
smoke
tests,
because
python
is
very,
very
good
to
follow
compiler
box,
even
kernel
crashes
and
kernel
box.
Most
recently,
we
found
a
buck
in
akumo
on
PPC
64.