►
From YouTube: Integrating Cloud Native Data Plane (CNDP) with OMEC BESS-UPF - Manoj Gopalakrishnan & Elza Mathew
Description
Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.
Integrating Cloud Native Data Plane (CNDP) with OMEC BESS-UPF - Manoj Gopalakrishnan & Elza Mathew, Intel
Cloud Native Data Plane (CNDP) is a set of user space libraries for accelerating packet processing for cloud applications. It aims to provide better performance over standard network socket interface. It uses an I/O layer primarily built on top of AF_XDP; an address family optimized for high performance packet processing. The Open Mobile Evolved Core's (OMEC) UPF project implements a 4G/5G User Plane Function that follows the 3GPP Control and User Plane Separation (CUPS) architecture. This UPF is actively used as part of the Aether platform in conjunction with the SD-Core mobile core control plane. This talk presents the integration of CNDP with OMEC BESS-UPF, which is a software-based data path built on top of the Berkeley Extensible Software Switch (BESS) framework. The traffic flow through the UPF pipeline in a docker environment, the Kubernetes integration with AF_XDP plugins for Kubernetes and the Aether-in-a-box deployment will be covered. In addition, we describe platform technologies for GTP-U packet traffic steering and how this works along with XDP (eXpress Data Path) offload feature in NIC to redirect GTP-U packets directly to user space via AF-XDP.
A
Hello:
everyone,
my
name
is
elza
Matthew
I'm,
a
software
engineer
at
Intel
working
at
the
intersection
of
cloud
native
Technologies
and
packet
processing
software
libraries
I've
been
at
Intel
for
about
six
years
now
previously.
I've
also
worked
on
ethernet
networking
driver
software,
design
and
development
for
various
os's.
A
I
would
also
like
to
introduce
the
primary
author
of
The
Talk,
who
could
not
make
it
in
person
but
is
happy
to
answer
any
follow-up
questions.
Offline
Manoj
is
a
software
architect
in
data
play
networking
team
in
the
network
and
Edge
group
at
Intel.
He
is
currently
working
on
building
and
optimizing
Cloud
native
services
using
network
data,
plane
Technologies
and
has
over
20
years
industry
experience
in
multiple
technology
domains.
A
Today's
talk
is
about
the
work
we
did.
Integrating
Cloud
native
data
plane,
cndp,
which
is
a
collection
of
user
space.
Libraries
for
accelerating
packet
processing
for
cloud
applications
with
omac
best
UPF
AC
best
UPF
is
the
open
networking
foundations,
Omak
UPF
project,
which
implements
a
4G
5G
user
plane
function
based
on
the
3gpp
control
and
user
plane
separation
architecture.
A
We
will
talk
about
the
traffic
flow
through
the
UPF
pipeline
in
a
Docker
environment,
the
kubernetes
integration
with
the
afxdp
plugins
for
kubernetes
and
The
Ether.
In
a
box
deployment
model,
we
will
also
describe
platform
Technologies
for
gtpu
packet
steering
and
how
this
works,
along
with
offload
feature
in
the
Nic
to
redirect
gtpu
packets
directly
to
user
space
via
afxdp.
A
So
the
agenda
for
today's
talk
is
divided
into
three
sections.
First,
will
be
on
cndp,
where
we'll
start
off
with
the
motivation
for
cndp
go
into
a
little
bit
of
detail
about
what
cndp
is
and
the
various
components
that
comprise
it.
We
will
also
talk
about
the
cndp
kubernetes
deployment
model
and
the
afxdp
plugins
for
kubernetes.
A
A
Bring
into
the
first
section,
cndp
or
Cloud
native
data
plane,
we've
had
great
success
with
dpdk
and
VPP.
So
why
another
development
kit
primary
reasons
are
sometimes
data
planes
are
not
designed
to
operate
in
a
hybrid,
private
or
public
Cloud
environment.
This
is
because
of
Hardware
requirements
such
as
CPU
memory
and
networking
interface
to
better
align
with
the
cloud
native
environments
and
principles.
We
need
a
data
plane
that
doesn't
have
these
restrictions.
A
A
Cndp
was
created
to
enable
Cloud
native
developers
to
use
afxdp
and
other
interfaces
in
a
simple
way,
while
providing
better
performance
as
compared
to
standard
Linux.
Networking
service
interfaces,
cndp
does
not
replace
dpdk
dpdk
still
provides
the
highest
performance
packet
processing
dpdk
implements
user
space
drivers,
bypassing
kernel
drivers,
and
that
is
one
of
the
reasons
why
it
achieves
the
highest
performance
for
packet.
Processing
dpdk
also
implements
a
framework
for
initializing
and
setting
up
platform
resources
scanning
PCI
bus,
allocating
memory
via
huge
Pages
Etc.
However,
in
contrast
to
dpdk
cndp,
does
not
have
custom
drivers.
A
Instead,
it
expects
the
kernel
drivers
to
implement
afxdp,
preferably
in
zero
copy
mode,
since
there
are
no
PCI
drivers,
there's
no
PCI
bus
scanning
and
we
do
not
require
physically
contiguous
and
pin
mapenary.
This
simplifies
deployment
for
cloud
native
applications
while
gaining
the
performance
benefits
provided
by
afxdp
cndp
fits
the
void
between
flexibility
and
performance.
We
target
10x
performance
over
Linux
applications
using
sockets
and
also
clean
integration
into
various
Cloud
tool
chains,
as
a
requirement.
A
A
It
aims
to
provide
better
performance
than
that
of
standard
networking
socket
interfaces.
The
I
o
layer
is
primarily
built
on
afxdp.
This
is
an
interface
that
delivers
packets
straight
to
the
user
space,
bypassing
the
kernel.
Networking
stack
cndp
also
provides
ways
to
expose
metrics
and
Telemetry
with
examples
to
deploy
Network
Services
on
kubernetes
cndp.
Consumers
include
Cloud
Network
function
developers
as
well
as
consumers.
Developers
who
create
applications
based
on
cndp
will
be
able
to
abstract
away
the
low
level.
I
o
that
cndp
takes
care
of
and
focus
on
their
application.
A
The
consumers
who
consume
the
applications
developed
by
the
CNF
developer
can
take
advantage
of
cndp's
deployment
models
for
their
applications.
Using
kubernetes
cndp
follows
a
set
of
cloud
native
principles:
functionality,
usability
interoperability,
portability,
performance,
observability
and
security,
and
here's
how
on
functionality,
cndp,
provides
a
framework
that
enables
Cloud
native
developers
full
control
of
their
application.
Usability.
A
Cndp
enables
the
developer
to
create
applications
by
providing
apis
that
abstract
the
complexities
of
the
underlying
system.
Interoperability,
since
cndp,
is
built
on
top
of
afxdp,
it's
possible
to
move
the
application
across
environment
from
public
to
private,
to
hybrid
Cloud
wherever
afxdp
is
supported.
A
A
Observability
and
security
is
another
key
aspect
that
cndp
focuses
on
metrics
are
exposed
via
Prometheus
Asians
and
security
is
also
first
class
Citizen
and
we'll
come
to
that
in
the
next
slide.
This
diagram
showcases
the
various
components
that
comprise
the
NDP.
You
have
the
core
libraries,
the
application
libraries.
You
also
have
the
cloud
native
stack,
which
is
ibv4
UDP
TCP
networking
stack
designed
using
the
cndp
graph
node
Library.
A
This
is
a
diagram
of
the
cndp
and
kubernetes
deployment
model,
which
shows
the
integration
of
cndp
with
the
AF
XDP
plugins
for
kubernetes.
This
is
a
device
plugin
and
cni.
The
benefits
of
this
integration
is
twofold:
security
and
scalability
Security.
In
order
to
run
the
cndp
application
in
a
secure,
unprivileged
pod,
there
were
two
aspects
of
afxdp
socket
creation
that
needed
to
be
done
by
the
afxdp
device,
plugin
and
cni.
That
is
the
loading
of
the
evpf
program
on
the
net
Dev
and
updating
the
air
xsk
map
with
the
file
descriptor
scalability.
A
A
A
It
is
the
first
networking
switch
that
with
software
switch
designed
to
support
nfv
in
Tradition.
In
addition
to
traditional
virtual
networking
tasks,
there
are
four
components
of
best
best
d:
the
ports,
the
modules
and
best
Kettle
best
utl
is
the
controller
for
bestd
and
it
offers
a
command
line
interface,
allowing
an
administrator
to
configure
which
boards
are
connected
to
which
modules
and
so
on
best
D
is
the
Daemon,
as
the
name
suggests,
and
it's
the
core
software
switch
ports
are
the
interfaces
where
packets
may
enter
or
exit
best.
A
D
and
modules
are
pieces
of
code
that
allow
bestie
to
inspect
and
modify
the
packets
for
integration
of
cndp
with
Bess,
we
started
with
the
cndp
best
port,
which
enables
us
to
send
and
receive
packets
to
and
from
the
networking
interface
using
afxdp.
We
added
support
for
this,
along
with
the
existing
dpdk
port.
A
A
A
A
The
pfcp
agent
implements
data
path,
plugins
that
translate
pfcp
messages
to
data
path,
specific
configurations-
and
there
are
two
data
path
plugins
currently
in
the
project.
One
is
the
best
plugin
and
one
is
the
up4
plugin,
the
one
that
we
are
interested
for.
Rcndp
integration
is
the
best
plugin,
since
we
added
the
cndp
port
to
bestd,
we
integrate
with
the
best
plugin
in
Omak
UPF.
A
A
A
A
In
our
current
setup,
we
used
Intel
ethernet
controller
E8
and
civil
qsfp
with
DDP
profile.
That's
the
dynamic
device
personalization
for
Telecom
telecommunication
workloads,
gtpu
enabled
we
use
the
out
of
tree
driver
and
set
TC
filter
rules
on
axis
and
core
networking
interfaces
to
do.
Gtpu,
RSS,
based
on
the
inner
UE
IP
address
in
the
encapsulated
gdpu
packet.
A
A
A
A
The
AFX
DP
cni
was
used
to
create
the
network,
attachment
definition
for
the
axis
and
the
core
networking
interfaces,
and
that
is
about
the
kubernetes
integration
aspect
now,
I'd
also
like
to
introduce
ether
in
a
box
and
how
we
integrated
the
cndp
best
UPF,
with
ether
in
a
box
ether,
is
onf's.
5G,
LG,
LTE
connected
Edge
platform
as
a
service.
A
It's
the
first
open
source,
5G
platform
for
enabling
Enterprise
digital
transformation.
It
provides
mobile
connectivity
and
Edge
cloud
services
for
distributed
Enterprise
networks
as
a
cloud
managed
offering
it's
an
open
source
platform,
optimized
for
multiple
multi-cloud
deployments
and
simultaneous
support
for
wireless
connectivity
over
various
Spectrum
either
in
a
box.
On
the
other
hand,
it
provides
an
easy
way
to
deploy
ether's,
SD,
core
and
other
components
and
then
run
basic
steps
to
validate
the
installation,
so
it
can
be
set
up
with
either
a
4G
or
a
5G
SD
core.
A
If
the
ROC
is
not
deployed,
you
can
also
use
a
simple
tool
called
Sim
app
to
configure
the
required
state
assume
the
values.yaml
that
was
provided
to
the
helm,
charts
from
The
Ether
in
a
box,
repo
was
modified
to
use
the
local
images.
The
UPF
mode
was
set
to
cndp
and
we
tested
it
with
the
5G
SD
core.
A
So
now
we
will
see
a
demo
of
The
Ether
in
a
box
integration
with
cndp.
First,
we
are
doing
a
make
reset
5G
test.
So
in
that
the
helm
charts
get
deleted,
the
release
is
uninstalled
and
we
wait
for
all
the
pods
to
terminate.
If
you
notice,
we
have
a
pod
for
AMF.
We
have
a
pod
for
SMF
and
upf0
and
so
on.
A
So
our
changes
are
in
the
upf0
pod
and
which
has
the
cndp
plus
best
UPF
image,
and
then,
when
we
do
make
5G
test,
the
Helm
charts
get
downloaded
and
then
the
simulation
starts
running
Helm
charts
are
the
primary
method
of
installing
the
SD
core
resources
and
ether
in
a
box
provides
a
great
deal
of
flexibility
when
it
comes
to
which
Helm
chart
versions
you
want
to
install.
There
are
local
definition
of
charts,
then
latest
charts
that
you
can
get
from
the
tip
of
Master.
A
A
The
data
I
face
specified,
there
is
a
dummy
networking
interface
and
it
uses
Mac
VLAN
networks
called
core
and
axis,
and
the
behavior
of
the
UPF
is
to
forward
packets
between
its
access
to
the
core
interface,
while
at
the
same
time
removing
and
adding
GTP
encapsulation.
On
the
axis
side,
Upstream
packets,
arriving
on
the
access
side
from
the
UE
have
their
GTP
headers
removed
and
the
raw
IP
packets
are
forwarded
to
the
core
interface.
A
So
now
that
the
simulation
is
over,
we
can
look
at
the
best
UPF
pipeline,
which
ran
while
the
simulation
was
happening,
and
that
is
on
the
next
slide.
So
this
is
the
best
UPF
Pipeline
and
it's
graph
based
and
you
can
see
the
package
drivers
seeing
the
pipeline
going
through
each
of
the
nodes
in
the
graph
and
the
output.
View
mode
is
set
to
the
total
packets
received.
A
So
that's
the
demo,
to
summarize
cndp,
is
a
recently
open
source,
Cloud
native
solution
for
accelerating
packet
processing
applications.
The
integration
of
cndp
with
Omak
UPF
highlights
some
of
the
achievable
improvements
with
5G
deployments
have
a
slide
in
here,
which
has
some
useful
links.
The
links
to
the
GitHub
repos
for
each
of
the
projects
mentioned
in
the
slide
deck,
as
well
as
links
to
the
blog
posts,
webinars
and
Technology
guide.