►
Description
Presented by Ash Herr, Artist, EMPOWA
In this session, multimedia artist Ash Herr explores how the integration of AR in our social platforms has created a new art form. She then breaks down how you can create an AR experience that is is engaging & comfortable. Topics include:
screen consideration
environment situations
illusion factor
audio enhancements
motion control
object interactions
For more from GitHub Universe 2020, visit https://githubuniverse.com
As always, feel free to leave us a comment below and don't forget to subscribe: http://bit.ly/subgithub
Thanks!
Connect with us.
Facebook: http://fb.com/github
Twitter: http://twitter.com/github
LinkedIn: http://linkedin.com/company/github
About GitHub
GitHub is the best place to share code with friends, co-workers, classmates, and complete strangers. Millions of people use GitHub to build amazing things together. For more info, go to http://github.com
A
Hi
everyone,
my
name,
is
ash
her,
I'm
a
multimedia
artist
and
creative
technologist.
I
work
in
augmented
reality
and
I
think
ar
is
one
of
the
most
exciting
mediums
for
modern
day.
Artists
before
ar
even
came
along.
Artists
have
always
been
interested
in
breaking
down
the
boundaries
between
natural
and
artificial
realities,
which
largely
parallels
the
work
being
done
in
ar
today.
A
But
apart
from
art,
there
are
so
many
other
use
cases
for
ar
and
the
principles
of
what
makes
a
magical
ar
experience
is
universal,
so
whether
you're
creating
an
art,
installation,
an
app,
an
interactive
birthday
card
or
a
game.
I'm
here
to
share
with
you
today
how
to
create
those
great
mobile
ar
experiences.
A
So
at
a
high
level,
there
are
presently
two
types
of
mobile,
augmented
reality:
experiences
you're,
either
augmenting
an
object
or
you're
augmenting
a
place,
augmented
objects
are
things
like
face
filters
or
making
a
poster
card,
or
some
other
2d
screen
come
to
life.
Augmented
places
are
things
like
location-based
tours,
visualizing
furniture
in
a
space
or
creating
a
fictional
narrative,
regardless
of
what
you
are
augmenting.
There
are
four
elements
that
you
will
need
to
consider
in
developing
these
experiences.
A
A
Now
a
touch
screen
serves
three
purposes
for
your
2d
interactions
as
a
3d
cursor
and
as
a
viewing
window
for
your
ar
experience,
and
while
it's
tempting
to
call
ar
an
immersive
experience,
we're
still
constrained
by
the
limits
of
our
screen
and
because
the
screen
is
a
window
to
our
new
world.
It's
important
to
maximize
the
visual
display
of
it
having
too
many
controls
clutters
the
interface,
and
it
distracts
from
the
augmented
experience,
so
keep
the
screen
simple
and
consider
hicks
law,
where
the
need
to
make
decision
increases
with
the
number
and
complexity
of
choices.
A
A
Another
screen
related
consideration
is
the
comfortable
to
reach
areas
on
a
device.
It's
best
to
place
your
important
controls
in
these
easy
to
reach
areas,
and
lately
more
apps
are
utilizing.
The
bottom
of
the
screen
for
these
important
controls
here
are
some
examples
where
the
primary
interaction
elements
in
augmented
reality
are
located
in
those
easy
to
reach
areas.
A
So
when
your
user
is
getting
started,
set
expectations
on
the
ideal
conditions
for
using
your
ar
like
defining
the
amount
of
space
needed
or
if
there
should
be
more
than
one
user
participating.
This
will
prime
your
user
for
the
best
ar
experience
as
you
intended
it.
You
can
also
provide
contextual
guidance
if
the
environment
is
not
good
enough
ar
core
and
ar
kit
both
have
built-in
systems
for
light
estimation.
A
So
if
the
environment
is
too
dark
or
too
bright,
you
can
tell
the
user
that
they
can
try
to
find
a
better
place
to
use
your
ar
on
the
screen.
Here,
I'm
showing
two
examples
where
the
user
is
asked
to
set
up
the
scene
correctly
for
the
experience
on
the
left
side
of
the
screen,
the
user
is
asked
to
use
the
back
facing
camera
and
on
the
right
side
of
the
screen,
the
user
is
being
asked
to
bring
in
another
individual
into
the
experience.
A
Your
environmental
situation
also
influence
how
users
interact
within
your
ar.
There
are
generally
two
categories
here:
it's
either
an
experience
for
a
private
environment
or
a
public
one.
In
a
private
environment
like
at
home
or
at
work,
you
can
create
longer
user
sessions
with
more
complex
interactions.
A
Here,
you'll
also
find
that
users
are
more
willing
to
utilize
their
whole
body
for
movement
within
the
interactions.
Portals
are
a
good
example
of
ar
that
thrives
in
private
environments,
ar
portals
encourage
the
user
to
explore
and
move
around
the
real
world
to
discover
different
elements
of
the
ar
scene.
These
generally
take
a
bit
more
time
to
get
through,
especially
when
you're
thorough.
On
the
other
hand,
there
are
public
environments
like
the
outdoors
where
users
are
partial
to
shorter
user
sessions.
A
This
doesn't
mean
that
long
sessions
should
be
out
of
question,
but
it's
good
to
have
a
balance
between
your
2d
and
3d
screens,
so
that
a
user
isn't
too
fatigued
pokemon
go
is
a
really
good
example
of
this.
These
interactions
within
our
mobile
ar
window
brings
me
to
my
next
consideration,
which
is
motion.
A
A
But,
regardless
of
how
the
user
is
positioned,
they
will
need
to
be
holding
a
device
in
their
hands,
and
these
device
types
will
also
vary.
Creating
a
new
challenge
for
accessibility,
an
iphone
8
would
be
much
easier
to
hold
than
an
iphone
12
pro,
which
is
easier
to
hold
than
an
ipad.
Holding
a
device
for
longer
periods
can
be
fatiguing,
especially
after
the
30
second
mark.
Therefore,
as
a
result,
many
great
ar
experiences
have
shorter
sessions
or
built-in
periods
of
downtime.
During
the
experience.
A
One
more
thing
to
consider
is
that
the
context
in
which
your
user
will
be
utilizing
their
ar
experience
matters.
For
example,
an
ar
experience
inside
a
grocery
store,
may
need
to
account
for
a
user
that
would
be
holding
a
basket
or
pushing
a
cart
in
addition
to
holding
their
device.
Another
example
is
that,
if
your
experience
is
at
an
art
gallery
is
likely
that
the
user
wouldn't
need
to
hold
the
device
at
all,
and
so
these
factors
would
influence
your
users
ability
to
navigate
within
your
ar
space
and
how
you
present
motion
within
the
experience.
A
A
So
speaking
of
the
different
cue
types,
an
example
of
a
visual
cue
would
be
like
highlighting
recommended
options
or
showing
text
that
encourages
you
to
follow
a
command
or
placement
guides
for
the
tracking
and
placement
of
3d
objects.
The
examples
that
I'm
showing
on
the
screen
here
are
both
of
instructional
text,
so
motion
cues
are
more
prominent
in
face
filters
where
a
user
would
be
expected
or
instructed
to
move
their
head
or
open
their
mouth
to
trigger
interactions.
A
Lastly,
a
good
example
of
an
animation
queue
is
like
the
fox
that
was
in
google
maps
ar
here.
A
fox
would
walk
in
front
of
you
and
help
you
navigate
where
to
turn.
I
don't
believe
that
this
is
still
a
feature
in
google
maps
ar
today,
but
the
subtle
animations,
like
these
highlighted
arrows,
do
the
job
just
as
well.
A
A
And
lastly,
let's
talk
about
the
most
important
aspects
of
augmented
reality:
the
illusion,
regardless
of
the
aesthetic
or
style,
that
you're
going
for
ar
objects
that
engage
with
and
reflect
their
environment
are
the
ones
that
make
ar
magical
incorporating
things
like
shadows,
lighting,
occlusion
reflection
and
collision.
All
support
the
illusion
of
your
ar
for
3d
objects,
attention
to
detail
really
matters
for
models
that
you
want
to
look
real
use
physically,
based
rendering
texture
models.
A
You
can
reduce
the
size
by
using
compression
tools
like
draco
or
reducing
the
polygon
count
of
your
objects.
Furthermore,
light
and
shadow
are
also
critical
in
creating
realism
in
ar
so
be
sure
to
reflect
environmental
lighting
conditions
onto
your
virtual
objects,
cast
object,
shadows
and
add
reflections
onto
surfaces
to
create
that
more
realistic.
Look.
A
I
found
that
the
best
place
to
position
light
sources
is
overhead
at
the
12
o'clock
position
and
it's
also
likely
to
be
more
congruent
with
the
lighting
conditions,
that
of
your
user
as
opposed
to
directional
lighting.
Lastly,
sound
is
also
a
wonderful
way
to
delight
in
ar,
by
setting
the
scene,
creating
a
mood
and
adding
to
the
illusion.
You
can
also
use
sound
to
guide
your
user
around
the
virtual
space
or
as
a
tool
in
confirming
interactive
elements
within
your
3d
space.
A
As
you
can
see,
there
are
many
ways
and
combinations
in
creating
engaging
augmented
reality.
There's
also
so
much
more
here
on
building
great
ar
experiences
in
regards
to
shaders
textures,
animations
and
interactions.
But
that
is
a
talk
for
another
day
today
we
spoke
to
considerations
for
screen
environment
motion
and
illusion
factors
in
building
your
ar
experience
and
keep
in
mind
ar
is
still
evolving,
and
there
is
so
much
more
to
be
created.
A
A
Is
that
they?
Let
you
take
currently
and
available
features
with
you
whenever
you
switch
between
ar
platforms.
So
if
a
feature
is
enabled
on
one
platform,
but
not
another,
they'll
help
you
transition
so
that
whenever
you
are
switching
platforms,
you're
not
rebuilding
the
ar
experience
from
scratch,
and
then
we
have
lens
studio
by
snapchat,
which
is
also
incredibly
robust
and
also
has
good
documentation
to
get
non-developers
started
in
augmented
reality.
A
Another
pro
with
lens
studio
is
that
you
can
quickly
deploy
your
ar
and
snapchats
to
its
large
user
base
and,
lastly,
I'll
talk
about
spark
ar
which
is
facebook's
ar
platform.
I've
been
using
spark
ar
more
often
as
of
late
and
similar
to
lens
studio
spark
ar
is
also
really
great,
because
much
of
the
ar
infrastructure
is
already
built
for
you
and
it's
an
easy
way
to
distribute
and
share
your
work
as
it
publishes
your
ar
experience
to
its
users
on
facebook
and
instagram.
A
Next
I'll
speak
to
some
of
the
other
tools
that
are
more
focused
on
creating
the
3d
content.
Within
your
ar
experience,
I
won't
be
speaking
to
all
of
them
in
the
interest
of
time,
but
I'll
start
here
with
sketchfab
and
sketchfab
is
a
really
great
platform
for
discovering
3d
objects.
You
can
purchase
or
even
find
free
3d
models
to
download
here
and
incorporate
into
your
ar
experience.
A
There
are
a
ton
of
really
great
models
here,
and
here
we
have
quill
and
tilt
brush,
which
are
both
vr,
drawing
tools
where
you
can
create
3d
models,
animate
them
and
then
incorporate
that
into
your
ar.
You
can
also
get
some
pretty
cool
workflows
here
and
lastly,
here
blender
and
cinema
4d
are
both
incredibly
powerful,
3d
graphics,
tools
for
rendering
animation
and
modeling
blender
is
awesome
because
it's
free
and
incredibly
powerful.
A
I've
used
it
for
modeling
sculpting
rigging
and
rendering
some
of
the
3d
models
that
I've
used
in
my
ar,
but
both
of
these
tools
are
really
really
incredible.
I'll
close
with
this
quote
here
and
I
encourage
you
to
go
and
create
an
ar
create
those
experiences
that
are
worth
sharing.
Thank
you.
So
much
for
watching
feel
free
to
keep
in
touch.
I
would
love
to
see
the
things
that
you
make
in
ar
hope
you
enjoy
the
rest
of
your
conference
and
thank
you
for
tuning
in
take
care.