►
From YouTube: Torus Community Meeting November 2022
Description
Monthly meeting to discuss Open Learning Initiative's next generation platform. In this meeting, we provide a demonstration of the latest functionality and answer questions from the participants.
Find the Slide Deck here: https://docs.google.com/presentation/d/1rZCE83XlaVaJldju423y_zNQfUgTSi5L/edit?usp=sharing&ouid=110529173836670653351&rtpof=true&sd=true
A
A
Okay,
let's
get
started
so
welcome
everybody!
It's
nice
to
see
such
a
big
crowd
here
today,
or
people
interested
in
seeing
the
latest
developments
in
our
Taurus
platform,
I'm,
Erin,
cerwinski
and
I'll
be
taking
you
through
some
demo.
Today
is
a
tourist
demonstration
we're
going
to
show
you
a
little
bit
about
counts.
This
is
just
a
quick
little
set
of
bullets,
but
we'll
be
looking
through
the
instructor
view.
Through
the
LMS
view,
graded
Pages
Gradebook
we're
going
to
see
a
bunch
of
other
stuff
as
well.
A
Anyone
can
go
and
get
a
free
account
and
sign
up
to
get
either
instructor
author
encounts,
whatever
you
need
I'm
going
to
sign
as
an
author,
so
I
can
show
you
some
of
the
authoring
capabilities,
but
first
I'm
going
to
take
you
over
to
after
I
get
into
my
course
here.
So
this
is
a
list
of
all
the
projects
that
I've
built
or
been
added
to
over
the
over
the
time
of
the
building
out.
A
Tourists
and
I
am
going
to
use
this
course
in
particular,
this
Cuisine
of
Northern
Spain
to
Showcase
some
things.
This
is
the
over
project
overview.
Where
you
can
have
a
description.
You
can
add
folks,
add
collaborators.
If
you
have
their
email,
you
can
just
add
them.
They
don't
have
to
have
an
account
they'll,
be
prompted
to
get
the
right
account
to
set
up
to
get
into
the
course
that
you're
sharing
with
them-
and
this
is
the
authoring
side
of
things.
A
By
the
way
we
have
a
number
of
advanced
activities
that,
if
you
think
you're
going
to
use
as
part
of
your
project,
you
can
add
them.
Otherwise,
we
keep
them
out
of
the
the
toolbar
as
as
a
selection,
unless
you're
really
going
to
use
them
just
to
keep
the
toolbars
at
a
minimum
and
not
unwieldy,
and
then
you
have
some
controls.
A
As
an
author,
as
to
other
kinds
of
things
you
want
to
do,
I
am
going
to
show
you
really
quickly
what
it
looks
like
from
the
instructor
side
through
a
canvas
account,
so
tourist
integrates
with
all
lms's.
So
if
you
need
to
publish
a
course
and
have
students
get
into
it,
you
can
do
that
through
your
LMS
and
let
me
make
sure
so
let
me
look
at
all
courses
here.
A
So
are
you
seeing
my
all
courses
window
and
canvas
I
just
want
to
make
sure
when
I
moved
my
desktop?
Yes,
thank
you.
So
I
have
a
number
of
courses
here
that
I've
published
and
then
I'm
an
instructor
in
that
I've
set
up
through
my
canvas
shell
and
this
cuisine
in
Northern.
Spain
is
just
one
of
them,
and
so
some
things
I
want
to
show
you,
as
this
was
already
set
up
and
I
have
I.
A
You
have
the
ability
to
manage
some
things
as
an
instructor
who
set
up
a
course
section
in
their
LMS
very
similar
overview
page
like
the
one
I
just
showed
you
as
the
author,
but
you
have
some
controls
right
through
here
for
whatever
course
you
set
up.
So
you
can.
You
know
preview
the
course
content
you
can
enter
it
as
a
student
and
see
what
the
student
sees
you
can
customize.
The
curriculum
right
here
from
this
particular
course
section
I
can
move
things
around
like
right
here.
C
A
Darren
I
was
going
to
try
that
next,
because
I
knew
that
that
was
available.
So
that's
helpful
to
know
that
you
can
move
things
around
a
bit
like
like
Darren
said
this
course
doesn't
have
containers
such
as
units
and
modules.
But
if
you
did,
you
would
be
able
to
rearrange
them
any
way
you
want
so
I'm
going
to
save
that
we'll
go
back
to
manage
so
that
was
showing
off
the
being
able
to
customize.
You
can
also
manage
gating
and
scheduling
here.
A
A
You
can
manage
updates,
which
is
what
I'll
show
you
I'll
show
you
that
a
little
bit
later,
when
I
make
a
change
to
the
the
authored
version
of
the
course,
and
then
you
have
the
ability
to
manage
section
details,
and
you
can
see
that
and
I'll
show
you
this
later
on
too
manually.
Graded
activities
actually
show
you
that
right
now,
so
we
have
the
ability
to
embed
activities
now
in
our
courses
that
can
be
manually,
graded,
there's
also
a
file
upload
ability
as
well.
A
If
you
want
students
to
be
able
to
upload
a
file
and
they
have
the
instructors
grade
that
manually
as
well.
Actually
what
I
wanted
to
show
you
right
now
is
the
grade
book,
so
in
this
particular
course.
If
I
go
to
grades,
one
of
the
things
that
we
have
is
a
tight
integration
with
the
grade
book
in
lms's.
A
A
A
little
bit
more
so
I
wanted
to
just
point
that
out,
let's
see
so
the
other
parts
of
this
man's
section
right
now,
I
can
show
you
that
I
in
this
course
and
you'll
see
this
I'm
going
to
show
you
the
author
version
of
the
course
there
are.
There
is
a
single
response
that
I
want
to
gr
that
I
want
to
have
instructor
graded.
It's
basically
an
open-ended
response,
question
and
there's
a
place
here
where
you
can
go
and
manage
those
and
see
those
results.
A
A
A
A
D
A
Lot
of
things
there's
this
overview.
I'll
show
you
objectives
in
a
second
activity:
Bank
bibliography
curriculum
and
now
there's
a
view
to
view
all
pages
for
those
who
are
familiar
with
Echo
that'd,
be
similar
to
the
resources
tab,
a
place
where
you
can
just
see
a
list
of
all
the
pages
outside
of
their
containers.
If
you
have
containers
like
units
and
modules,
insights
is
where
you
can
go
to
get
some.
Some
data
that's
been
generated
on
your
course
courses
through
the
course
sections
and
we're
going
to
go
start
with
objectives.
A
So
objectives
are
an
important
part
of
all
Oli
courses.
We
have
the
ability
to
do
objectives
and
sub-objectives
and
to
tag
activities
to
any
of
those.
The
sub-objectives
which
we
used
to
call
skills
or
can
be
what
you
call
Knowledge
components,
or
you
can
tag
to
the
larger
ordering
objective.
Darren,
actually
is
going
to
show
off
some
new
tinkering.
We've
done
with
this
interface
and
some
new
functionality
that
is
available
to
folks
to
manage
their
objectives
and
sub-objectives
a
little
bit
better,
so
stay
tuned
for
that
we
have
an
activity
Bank.
A
This
activity
bank
is
a
place
where
you
can
generate
pools
of
questions
that
can
be
pulled
in
to
either
as
formative,
assessment
or
graded
assessment
items,
and
so
I
have
populated
here.
A
couple
of
multiple
choice.
Questions
and
I'll
show
you
how
that
works
later
on,
but
you
have
the
ability
in
the
activity
Bank
to,
of
course
determine
learning
objectives
for
each
of
the
activities
that
you
develop.
A
Questions
tag
them
with
various
tags
that
you
can
create
any
tags
that
you
want
and
then,
when
we
go
when
I
show
you
later
how
to
pull
those
into
a
page,
you
have
the
ability
to
select
from
tags
or
objectives
or
type
or
even
specific
text,
to
pull
activities
in
in
a
in
a
dynamic
way.
In
other
words,
and
we'll
see
that
in
a
minute
we
have
a
bibliography
which
might
be
new
to
some
folks.
A
So
this
is
a
place
where
you
can
generate
references
for
your
courses,
and
you
can
add
them
all
here
or
you
can
add
them
as
you're
building
your
pages
and
they'll
they'll
populate
here
and
as
you're
building
your
pages,
you
can
select
from
your
activity
Bank
the
citations
that
you
want,
that
you've
added
here
and
there's
lots
of
cool
controls.
You
can
do
it
through.
A
Any
number
of
types
of
references
I'm
going
to
dive
into
the
curriculum,
so
I
have
a
curriculum
here,
set
up.
There's
only
four
pages
in
my
curriculum.
I
didn't
do
anything
fancy
like
units
and
modules,
but
you
have
the
ability
to
do
all
of
that
by
adding
these
types
of
you
can
add
a
page
by
adding
a
practice
page
add
a
graded
assessment
page
or
a
container
once
you
click
unit.
If
you're
going
to
add
a
unit,
then
you
have
the
option
to
again
add
practice:
Pages
graded
assessments
or
modules
within
those
units.
A
So
it
allows
you
to
build
out
that
hierarchy
and
I'm
just
going
to
check
the
chat
here
thanks
thanks,
Michael
we'll
take
more
of
your
once.
You
see
what
we've
done
so
far
with
the
objectives,
then
we're
again
we're
always
looking
for
refinement
and
for
feedback
on
on
how
to
refine
further.
So
once
you
see
that
we
can
chat
about
what
you'd
like
to
see
next
so
I'm
just
going
to
dig
in
and
go
right
into
this
introduction
page
to
show
a
few
things.
A
So
the
way
you
build
build
content
is
like
most
content
editors
that
you're
probably
familiar
with
you
can
add
a
learning
objective
at
the
top
of
the
page,
just
like
you
can
in
Legacy
Oli.
We
have
this
ability
to
do,
grouping
which
I'll
showcase
a
little
bit
later
and
then,
of
course,
adding
any
number
of
things
like
text,
videos
tables
and
on
this
particular
page,
we're
going
to
show
you
some
new
formatting
options
for
tables.
A
You
know
heading
rows
so
that
they're
that
their
formatted
as
such
so
just
wanted
to
Showcase
that,
because
it's
pretty
exciting
to
have
those
kinds
of
controls
over
tables
that
we're
used
to
okay,
just
gonna
move
I
can
move
through
the
content
as
an
author,
similar
to
a
student
and
just
work
on
pages.
That
way
so
right
now,
I'm
going
to
the
next
page
and
on
this
page
I'm
going
to
show
how
to
insert
a
video
so
anywhere
you
are
on
a
given
page.
A
If
you
want
to
add
any
kind
of
content,
you
find
this
little
bar
right
here.
That
has
the
plus
and
you
can
click
and
you
can
add
all
kinds
of
things.
So
you
could
add
media
question
Bank
a
question
from
the
activity.
Bank
surveys.
We
have
the
ability
to
do
these
types
of
questions
right
now,
I've
added,
drag
and
drop
to
show
that
a
little
bit
later,
this
is
check
all
that
apply.
If
you
wanna
an
upload
file
upload
activity,
multiple
choice,
ordering
input
input
is
for
math
or
numbers
formulas
or
text
right
now.
A
What
I'm
going
to
add
is
a
video.
So
once
you
add
some
sort
of
piece
of
content,
you
get
controls
that
are
relevant
to
that
particular
piece
of
content.
In
this
case
I
can
add
tables,
I
can
add
images
and
I
can
add
videos,
I'm
going
to
add
a
YouTube
video
here
and
the
way
I
do
that.
Just
by
it
gives
me
this
box
and
I
thought
I
had
the
video
link
ready
to
not.
A
So
I
just
added
this
video
and,
as
you
can
see,
I
have
the
ability
to
add
a
caption.
I
also
can
have
some
additional
settings
with
regard
to
this.
Video
I
can
add
alternative
text
and
we're
working
to
improve
this
all
the
time
in
terms
of
the
the
video
settings
and
the
ability
to
manipulate
the
videos.
The
way
you
would
like
this,
in
particular
video,
it's
gonna,
say
about
that.
A
That's
all
I
wanted
to
say
about
videos
at
the
moment.
What
else
did
I
want
to
show
on
this
page?
So,
as
you
can
see,
you
can
have
headings
and
you'll
notice
that
we
have
this
left
hand
panel
and
that
controls
the
grouping
of
things.
So
you
can
add
groups
of
things.
Just
like
you
could
add.
Questions
within
multiple
questions
within
one
particular
box,
like
I,
did
I
get
this
box
and
I'll
show
you
on
the
next
page,
how
I'm
going
to
add
to
an
example
box
as
well.
A
C
Yeah,
so
at
the
moment
we
cannot
duplicate
a
question
within
a
page
I,
don't
think
that
that
exists.
Yet
let
me
look
you:
can
you
can
duplicate
an
entire
page
right
and
actually
say
if
I've
authored
one
page
and
create
a
copy
of
that
page,
but
within
a
page
I,
don't
believe
yet
there's
actually
ability
to
duplicate
a
question.
I.
A
So
I'm
just
moving
on
to
the
next
page.
Let's
work
on
this
page
a
little
bit.
So
what
I
want
to
show
you
in
this
page
there's
a
couple
different
things:
I
wanted
to
show
off
the
ability
to
I
want
to
show
you
that
we
now
have
these
semantic
type
boxes,
like
we've
had
in
Legacy,
where
we
can
designate
things
as
an
example.
A
simulation
many
students
Wonder,
learn
more
lab.
A
That
sort
of
thing,
so
we
have
the
same
kind
of
abilities
to
tag
content
as
as
what
its
purpose
is,
and
then
we
also
have
the
ability
you
can
see
that
this
example
has
three
items
in
it.
It
has
this
image.
It
has
some
text,
it
has
single
response
and
a
file
upload
I
wanted
to
show
those
off,
but
you
have
the
ability
to
add
things
to
this
group.
Just
like
you
would
a
page
or
any
other
container.
A
I
want
to
generate
a
question
kind
of
dynamically
on
the
fly,
as
the
students
encounter
it
and
pull
from
a
pool
of
questions.
So
you
saw
in
that
activity
bank
that
I
had
questions
and
now
I'm
going
to
add
one
of
those
so
I
want
to
add
a
bank
question
and,
as
you
can
see
it
gives
me
the
ability
to
add
any
number
so
I'm
going
to
add.
2
and
I
want
the
ones
that
have
this
particular
learning
objective
associated
with
it.
A
A
F
A
Well,
it's
blind
until
yeah,
because
you're
you're
you're
what
you're
telling
it
to
do
is
when
a
student
Encounters
this
page,
pulling
at
random
questions
from
the
activity
bank
that
are
tagged
with
this
learning
objective
or
tab
or
you
can
even
pull
in
like
I,
want
to
start.
I
only
want
multiple
choice,
questions
or
I
only
want
it's
a
wave.
You
remember
the
ability
to
do
pools
and
in
our
quizzes
it's
allowing
that
same
functionality
in
in
as
formative,
questions
as.
F
A
That's
what
I
was
showing
you
earlier
in
my
list:
I
showed
the
activity
bank
I
kind
of
breezed
over
it.
Here's
where
I
created
those
questions,
so
I
created
these
questions
here,
and
so
here's
where
you
would
see
those
questions
and
then
you
can
even
search
for
them
or
even
narrow
down
what
you're
looking
at
here,
based
on
any
of
the
criteria
that
you've
put
on
those
questions.
It'd.
F
A
C
E
C
Then
I
go
into
a
page
and
I
embed
an
activity,
Bank
selection
right
where
I
want
to
draw
one
question
randomly
you
know,
per
on
a
per
student
per
attempt
basis,
According
to
some
criteria.
I
think
it
would
be
really
helpful
in
that
page,
where
I've
embedded
that
activity
Bank
selection
to
have
some
sense
of
what
is
kind
of
the
art
of
the
possible.
What
am
I,
drawing
upon
by
the
by
the
logic
that
I've
constructed
in
that
particular
instance.
C
How
many
questions
could
match
right
so,
if
I
put
in,
for
instance,
only
questions
that
are
that
Target,
this
objective
it?
It
would
be
great
if
it
told
me
well,
there
are
35
total
right
and
you're
selecting
to
draw
one
randomly
from
that
Set
and
then
perhaps
an
easy
way
like
a
button.
That
then,
would
take
you
to
this
activity,
Bank
view
with
that
same
logic
configured,
so
that
you
would
have
the
an
easy
way
to
then
browse
and
see.
C
F
A
Yeah
right
and,
alternatively,
be
hard
to
say:
okay
here
here
are
all
35
questions
that
could
be
possible.
Right
Here
listed
in
this
page
I
think
that
would
be
also
confusing,
but
I
like
that.
What
this
has
led
to
is
this
conversation
has
led
to
is
some
additional
functionality
to
help
manage
activity,
Bank
selections
and
view
what
your,
what
you're
intending
to
do,
yeah.
F
B
Yeah,
oh
thank
you
yeah
for
these
activities.
Can
we
well
a
couple
questions
one?
Can
we
stack
them
so
that
you
don't
have
a
linear
list
of
questions?
You
know
we
want
to,
and
can
we
specify
the
order?
So
now,
if
we've
got
a
group
of
questions
that
we
want
to
sort
of
build
from
early
Concepts
game,
a
little
more
complex
as
it
they
are
solved,
can
we
do
that
or
is
it
going
to
be
truly
random.
H
Aaron,
yes
hi,
this
is
Ben.
Can
I
ask
a
question
so
I'm
I'm,
always
thinking
of
these
courses
are
something
students
work
their
way
through
and
and
you're
comparing
you
know
performance
under
different
conditions,
so
you
wouldn't
be
wanting
it's
it's
always
if
you've
got
different
versions
of
a
course.
You've
you've
always
got
the
hassle
of
trying
to
come
up
with
different
different
questions
that
are
of
equivalent
difficulty.
So
the
idea
of
just
selecting
a
random
question
from
a
bank
seems
like
it
would
just
multiply
the
complexity
of
that
task.
H
H
Then
it
would
be
okay
if
it
was
selecting
random
questions
that
they
hadn't
seen,
but
I'm
I'm,
just
I,
I,
guess
I
I,
guess
that
I
would
be
doing
kind
of
a
degenerate
form
of
what
you're
talking
about
here.
Where
there
would
just
be
one
question
to
select
from
is
there?
Is
there
a
way
of
of
toggling
between
those
two?
Does
that
make
sense?
We're
like
the
first.
A
H
C
It's
interesting
that
that,
actually,
behind
the
scenes,
the
implementation
of
this
activity
bank
is
designed
to
support
exactly
what
you're
describing
Ben.
So
we've
already
put
in
there
the
capability
that
one
could
Leverage
context
around
the
attempt
into
into
factoring
which
activities
to
draw
from
right.
C
So
you
can
actually
embed
in
this
logic
and
construct
something
that
says
you
know
only
select
questions
that
are
tagged
with
first
attempt
only
for
instance,
and
when
it
is
the
first
attempt
we
have
not
exposed
that
in
the
user
interface
yet,
but
it
would
be
relatively
straightforward
to
do
that.
I
was
reticent
to
do
that
from
the
beginning
only
and
that
it
would
I
thought
it
was
going
to
complicate
this
kind
of
Expression
Builder
user
interface
a
bit
too
much
and
it's
it
was
a
new
feature
right.
C
C
Interesting
one-
and
you
know,
and
another
feature
of
the
platform
that
might
be
suitable
in
this
case-
is
the
use
of
dynamic
or
templated
questions
where
a
question
can
be
constructed
with
eccentric
variables
right
in
in
the
questions
done
and
even
variables
in
the
feedback
and
what
the
correct
answer
is
and
then
right.
Every
student
gets
a
different
version
of
that
Dynamic
question
based
upon
some
evaluation
and
and
establishment
of
those
variables
all
right.
So
this
is
widely
used
in
some
of
the
stats
and
math
courses.
A
I
also
wanted
to
highlight
something
that
I
don't
know
if
folks
have
seen
before,
but
the
ability
to
do
surveys,
and
so,
when
you
add
the
survey
block
anywhere
in
the
course
you
have
the
ability,
then
to
add
any
type
of
question
to
it.
It
could
be
multiple
choice.
It
could
be,
it
could
be.
You
know,
open
response
and
what
that
does
and
Darren
you'll
have
to
help
me
out
here,
but
I
believe
it.
It
makes
those
questions
in
the
survey
form.
C
Yeah,
so
no
you,
you
touched
upon
I
think
the
the
the
main
one
is
that
right.
There
is
no
notion
of
right
or
wrong
for
those
questions
that
are
in
a
survey
and
thus
the
system
it
doesn't
even
show
feedback
to
the
student
in
the
way
that
write
a
multiple
choice.
Question
would
typically
do
after
after
the
student
makes
a
selection,
so,
but
the
other
important
aspect
is
right:
there's
no
score
calculated
for
a
question.
That's
in
a
survey,
so
you
as
an
author,
can
actually
embed
a
survey
in
a
graded
page
right.
C
A
A
And
there's
some,
you
know
questions
in
here,
but
I
wanted
to
show
this
case.
This
idea
of
this
content,
Break
the
content
breaks,
have
been
added
as
a
way
of
paginating
things,
so
it
could
be
in
in
this
case
it's
in
our
final
quiz,
where
now,
when
I
show
this
quiz
and
I'm
going
to
preview
this
quiz,
so
you
can
see
what
that
does
essentially
adds
these.
You
know
next
buttons
to
allow
you
to
have
page
through.
A
A
A
A
C
So
I
think
this
is
the
internally
with
the
system.
It
calls
the
activity
report
content
element,
so
this
is
I,
think
I
understand
the
ability
to
have
read
a
a
survey
in
one
page
in
the
course
and
then
later
in
the
course
show
the
students,
the
aggregated
results
right
of
what
their
peers
answered
on
another
page.
C
Okay
yeah,
so
so
so
this
feature
we're
looking
to
build
that.
Well,
we
know
we
know
we
need
to
support
this
for
that
backwards,
compatible
use
case,
but
we're
looking
to
expand
the
functionality
and
have
it
be
able
to
be
to
support
any
and
all
activity
types
that
that
exist
within
the
system.
I
think
there's
some
limitations
right
now,
with
the
way
that
that
works
in
Oli.
Currently,
it
can
only
show
the
results
of
we're
at
a
particular
type
of
activity
or
the
activities
that
can
exist
in
the
survey.
C
So
that's
a
slight
difference
in
tourists
in
that,
as
compared
with
the
current
Oli
platform,
a
survey
can
contain
basically
three
different
types
of
questions.
Right
you've
got
your
likert,
a
multiple
choice
and
then
an
open
response
in
Taurus,
a
survey
can
contain
any
type
of
activity,
so
any
activity
that
exists
in
the
system
can
exist
in
a
survey
and
when
it's
in
a
survey
it
just
operates
slightly
differently
right.
It
doesn't
show
feedback,
it's
it,
doesn't
roll
up
and
become
part
of
a
score,
but
it
also
once
we
introduce
that
reporting
capability.
D
A
C
C
But
beyond
that
set,
there
are
some
other
activities
that
we
know
that
we
want
to
build
and
provide
support
for
so
and
matching
activity.
I
think
would
be
a
great
one,
even
a
simple,
true,
false
activity
right,
which
is
really
kind
of
a
degenerate
case
of
a
multiple
choice,
but
that
was
just
far
easier
and
quicker
to
to
author
right.
So
so
some
ideas
like
that
that,
well,
you
can
accomplish
those
types
of
things
with
the
more
fundamental
collection
of
question
types
that
exist
in
a
lie
today.
C
A
If
there's
a
survey
question
and
a
page
I
notice,
the
students
can
reset
and
modify
the
response
at
any
time.
Is
there
a
way
to
see
history
of
responses
or
when
it
was
modified
and
again
dare
I
need
your
help
with
that?
One
I
can't
remember
how
the
data
works
with
viewing
questions,
question
attempts.
C
So
so
that's
a
relatively
new
feature:
I,
don't
think
it's
a
well!
It
is
available
on
proton
right
in
in
the
as
an
instructor.
You
can
review
attempts
on
graded
pages,
so
a
quiz
final
exam.
You
have
the
ability
to
look
to
see
by
navigating
through
the
manage
enrolled
students
starting
there
or
starting
at
the
grade
book.
C
You
can
go
look
at
individual
students
for
a
specific
page,
a
graded
page
and
then
see
all
of
the
attempts
that
they've
taken
click
through
and
then
look
at
how
they
actually
answer
individual
questions
so
that
exists
today.
Right
now
on
proton
for
graded
Pages
we've
extended
that
capability,
it's
not
yet
available
in
proton.
It's
it
is
running
in
our
test
system,
we're
now
as
an
instructor.
You
can
get
that
same
level
of
view
into
any
page
in
the
system,
so
including
practice
pages.
C
So
there
might
be
a
complex
check
all
that
apply
activity
on
a
page,
and
you
can
look
and
see
then
this
student
on
this
page,
you
know,
tried
this
activity
four
times
before
they
actually
got
it
correct
so
that
that
does
exist
in
our
in
our
test
environment.
We
haven't
deployed
that
and
a
collection
of
other
things
yet
to
to
the
production
system.
A
F
A
F
A
No,
we
just
have
not
built
a
learning
dashboard
yet
do
we
have
a
full
expectation
to
build
a
learning
dashboard,
so
this
is
that's
different
from
grade.
We
just
know
that
we've
wanted
many
folks
have
added
for
more
flexibility
and
functionality
around
Gradebook,
so
we're
trying
to
build
those
things
out,
but
does
not
replace
the
learning
dashboard.
Okay,.
F
A
C
I
have
five
total
attempts,
I
click,
Start,
I
answer
the
questions
and
I
submit
my
attempt.
So
it's
simply
that
flag,
whether
a
page
is
graded
or
not,
that
determines
if
the
score
gets
sent
to
the
LMS.
There's
no
other
mechanism
to
say
well,
I
I
want
to
keep
that
kind
of
graded
experience
within
the
system,
but
not
send
the
grade
to
the
MMS.
We
don't
have
the
capability
to
do
that,
so
to
turn
off
sending
the
grade.
You
have
to
turn
off
the
fact
that
it
is
a
graded
page
at
the
moment.
D
C
E
C
C
A
The
student
submission
for
that
there's
also
I
just
entered
oh
and
in
a
way
to
give
feedback
and
a
score
on
those.
So
this
is.
Let
me
show
you
again
what
that
What,
that
particular
activity
looks
like
in
the
curriculum
and
then
I'm
going
to
update
I'm
going
to
show
you
some
publishing
functionality
that
will
update
my
LMS
course
with
this
file
upload
question,
which
I
added
after
I
the
latest
update.
A
A
So,
as
an
author
of
the
course
I
have
the
ability
to
run
this
review
of
my
course
and
right
now
what
it
flags
for
me
or
any
accessibility
issues,
missing
alt
text
on
images,
any
content
where
I
have
activities
that
possibly
haven't
been
tagged
with
learning
objectives
yet
or
or
skills,
or
if
I
have
things
that,
like
I,
have
an
activity
bank
that
I'm
asking
for
to
embed
three
questions
here,
but
there's
only
one
in
the
activity
bank.
So
it's
not
gonna.
A
It
Flats
those
types
of
things
we're
going
to
be
adding
to
this
kind
of
audit
Tool
all
the
time.
So
if
you
have
ideas
for
things
that
you'd
like
us
to
flag
and
and
put
here
in
the
list-
and
you
can
dismiss
them
or
you
can
go
right
into
that
page
and
and
go
right
from
here-
click
in
and
fix
whatever
needs
to
be
fixed,
and
then
here
is
the
preview
course
button.
This
is
we'll
we'll
preview.
A
H
Mean
especially
for
the
kinds
of
studies
that
that
we've
done
in
the
past,
you
end
up
with
like
a
handful
of
questions
that
need
to
be
used
for
pre-test,
post-test,
quizzes
and
you're
flipping,
and
so
you
end
up
wanting
like
12
or
18
or
24
versions
of
questions
that
you
can
scatter
all
around.
That
are,
you
know
very,
very
similar
and
in
the
tool
that
that
we
were
using
before
it
was
just
so
error
prone
to
cut
and
paste
and
I
it
was.
H
It
was
perfectly
natural
for
me
to
use
an
Excel
spreadsheet,
but
then,
but
then
not
having
something
that
that
would
be
fairly
simple
compared
to
all
of
the
complexity
that
you've
already
got
it
just
it
just
led
to
an
incredibly
error-prone
process,
and
especially
if
there
was
a
bit
of
a
bit
of
support
for
that,
because
so
many
so
many
of
the
The
Fairly
generic
learning
studies
learn.
Lab
studies
require
that
kind
of
thing.
It
would
be
really
nice
to
have
that
and
the
next
time
we
do
run
a
big
study.
C
This
would
be
like
the
notion
that
I
know
I
need
these
24
questions
that
are
all
somewhat
related
and
probably
the
fastest
way
for
me
to
author
them
would
be
right,
just
like
in
an
Excel
spreadsheet,
right,
column,
A's,
the
stem
column,
B
is
the
correct
answer,
and
these
are
the
other
choices
and
then
I
can
copy
and
paste
and
quickly
put
those
variants
together
and
then,
if
there
was
a
feature
in
the
platform
Taurus
that
just
read
that
file
Elijah
uploaded
and
then
it
turned
them
into
questions
say
in
the
activity.
Bank.
H
That
would
certainly
be
one
way
of
doing
it.
You
know,
basically,
it's
like
in
a
you
know:
you've
got
pre-tests,
we
we
had
pre-test,
mid-tests
and
post-tests,
and
we
wanted
to
know
you
know
we
wanted
a
measure
of
students,
performance
on
on,
say
each
of
three
types
of
questions,
and
so
we
had
three
variants
of
each
one,
and
then
we
shuffled
those
around
in
different
subgroups.
C
Okay,
yeah
got
it
yeah,
so
this
is
more
of
an
actual
like
a
B
test.
We're
working
on
right
now
and
in
fact
one
of
our
Engineers
has
just
opened
a
poor
requests
for
the
most
of
this
infrastructure,
the
ability
to
support
what
we
call
Alternatives
and
groups
and
values
so
that
I
can
essentially
this
replicates
a
feature
from
Alli
of
the
same
name,
Alternatives
alternative,
but
we're
implementing
it
in
a
more
broad,
flexible
way.
That's
going
to
allow
us
to
do
pretty
much.
C
C
So
that
is
I
think
that's
interesting,
I
think
it's
a
I
would
view
that
as
a
bit
orthogonal
to
this
feature,
but
we
would
want
to
make
that
work
right.
So,
if
there's
a
need
to
allow
this
to
be
set
up
in
the
questions,
the
content
ingested
in
a
more
efficient
manner
than
having
somebody
manually
create
these
things
right
or
even
using
a
duplicate.
This
question
function
that
I
think
would
make
a
lot
of
sense.
C
Be
yeah
yeah
indeed,
and
we
had
some
of
this
functionality
and
the
echo
authoring
environment.
You
could
actually
ingest
a
Google
Docs
right.
It
would
turn
it
into
a
workbook
page
and
there
was
another
mechanism
to
pull
questions
from
a
spreadsheet.
We
just
haven't
pulled
forward
that
capability
in
Taurus,
yet
but
I
do
think
it's
very
powerful
right
for
folks
that
have
offline
content.
That's
that's
much
faster
than
using
the
web-based
UI
to
copy
and
paste
and
replicate
things.
H
C
There
is
actually
so
there
is
a
published
document
format
for
all
of
the
structures
within
a
tour,
a
tourist
course
from
the
curriculum
to
pages
to
activities,
and
we
have
an
ingestion
mechanism
so
that
one
can
construct
a
zip
file
with
all
of
the
resources
that
you
want
and
ingest
that
into
the
platform
now
right
now.
That
creates
a
new
course.
When
you
do
that,
we
could
extend
that.
C
We've
already
talked
about
it
to
allow
that
to
not
always
create
a
new
course,
but
just
simply
add
the
resource
that
it
the
resources
that
it
finds
and
that
zip
file
to
an
existing
course.
So
that's
I
know
an
existing
Avenue
that
could
allow
us
to
to
allow
the
automated
ingestion
of
new
resources
into
an
existing
course.
Okay,.
H
A
A
Once
we
get
the
base
functionality
in
place
and
as
Darren
said,
we
are
building
out
and
thinking
about
ways
of
supporting
a
b
testing
a
lot
more,
a
lot
better
Michael
to
answer
your
question
in
a
text.
Yes,
tourist
courses
can
be
Standalone,
they're,
not
dependent
on
an
LMS
I'm,
just
not
showcasing
that
functionality
at
the
moment,
because
it'll
complicate
the
the
larger
demo.
A
But
yes,
we
have
the
ability-
and
we've
been
doing
this
with,
for
example,
metal
students
in
an
e-learning
design
course
where
they
were
basically
pulling
together
courses
very
quickly
and
getting
them
out
for
testing,
and
you
can
deliver
those
courses
with
just
the
link
and
get
folks
into
those
and
using
them
either
anonymously
or
through
their
accounts.
So
lots
of
flexibility
in
terms
of
delivery
mechanisms.
A
Okay,
so
one
of
the
things
I
wanted
to
show
one
of
the
last
things
I
want
to
show
is
this
ability
to
okay
review
is
to
publish
and
by
the
way,
I'm
going
to
gloss
over
products,
but
essentially
products
are
a
way
of
providing
different
permeations
of
a
course
similar
to
if
you're
familiar
with
ooi
Legacy.
The
way
we
have
organizations
where
you
can
have
the
same
content
delivered
in
different
ways
or
or
different
configurations.
A
If
you
remember
I'm,
also
an
instructor
I
can
go
to
this
course
in
my
LMS
and
see
when
I
manage
the
section
that
there
is
an
update
available
and
then
I
can
as
an
instructor
go
in
and
I
can
review.
This
update
get
us
get
that
same
summary
and
decide
whether
I
want
to
apply
it
right
now
or
not
I'm
going
to
go
ahead
and
apply
it
so
that
then
I
can
show
you
how
instantly
this
works.
Essentially
so
I
believe
on
this
page
I
had
that
file
submission
activity
that
I
created.
A
A
When
we
look
at
the
text
here,
try
and
set
up
a
course
for
Taurus
alerts
me
to
when
students
begin
the
course
envisioning
a
class
that
all
students
would
be
welcome
to
take
an
acquaintance.
That's
an
interesting
use
case
maths,
so
basically
you're.
Looking
for
notifications
external
to
what
you
have
available
in
the
LMS
to
know
when
students
are
doing
certain
things
in
the
in
the
Oli
course.
I
Yeah
would
I
be
looking
for
is
to
set
up
a
course
on
just
say
scientific
information,
and
it
could
be
something
that
anybody
could
start
at
any
time
and
I
would
just
need
to
be
alerted
like
oh,
hey,
there's
somebody
in
your
course
now
and
they're
starting
to
do
exercises
or
something
like
that.
That
lets
me
know
that
I
need
to
go
in
and
pay
attention,
and
maybe
even
great
things.
You
know
or
give
feedback.
C
But
that's
only
going
to
be
at
the
level
of
granularity
of
right,
a
student
has
been
enrolled
and
once
they're
inside
of
Taurus
and
in
the
material,
it's
not
going
to
have
much
visibility
and
be
able
to
give
you
any
notification.
Beyond,
probably
a
grade.
You
know,
graded
page
was
completed
right.
A
new
thing
is
showing
up
in
the
LMS
Gradebook.
C
So
what
you're
asking
about
I
think
would
be
a
really
interesting
feature
that
if
the
platform
could
support
right,
a
collection
of
different
events
that
you
as
the
instructor
could
be
notified
upon,
whether
that
notification
was
when
you
first
log
in
probably
would
be
in
both
places
you
log
in,
and
you
look
at
the
manage
section
right.
You
would
have
some
way
to
see.
C
Oh,
you
have
13
new
notifications,
but
also
a
way
to
receive
those
offline
right,
so
so
to
get
an
email,
for
instance,
that
that
a
student
has
just
enrolled
in
your
course
or
a
student
has
submitted
a
page
attempt
that
requires
manual
scoring
so
that
that's
interesting
we've
not
encountered
that
use
case
exactly
in
the
past.
But
the
system
could
could
support
that
for
sure.
Yeah.
G
We've
had
a
similar,
similar
requests
from
two
of
the
users
who,
to
the
attendees,
the
the
modern
languages
team
and
Michael,
with
the
the
medals
team
have
both
requested
for
their
for
their
sort
of
public
courses,
especially
where,
where
they
are
asynchronous
some
sort
of
notification.
When
people
from
unexpectedly
sign
up
you
know
because
it's
not
planned,
you
know
it's
open
to
the
public
and
anybody
can
come
along
and
you
want
to
be
able
to
monitor
as
people
join
the
roster.
G
G
You
might
be
letting
in
a
guest,
and
you
don't
want
them
to
have
to
pay,
and
you
don't
have
some
sort
of
special
code
to
let
them
in
for
free,
so
they
sign
up,
and
then
you
grant
them
access
when,
when
they're
there
and
it's
nice
to
get
a
notification
in
that
kind
of
in
that
kind
of
setting,
so
we've
had
a
we've.
Had
a
lot
of
notification
needs
that
I
think
we're
going
to
work
into
the
new
system.
I
A
A
C
A
C
G
C
Grace
for
a
student
before
they
they're
they're
forced
to
actually
pay.
We
it's
a
plugable.
The
payment
provider
is
pluggable
in
the
sense
that,
like
we've,
built
this
out,
so
that
we
initially
had
a
requirement
to
allow
stripe
integration.
So
that's
what's
in
place
right
now.
We
have
not
yet
built
out
the
CMU
approved
payment
provider
CashNet.
C
So
I,
don't
think
that
we
can
claim
today
right
now
that
Taurus
supports
charging
for
courses
at
CMU
in
the
way
that
I
think
that
we
can
do
with
the
Oli
system
today
right
because
it's
not
going
to
go
through
CashNet
it.
It
only
supports,
there's
only
a
strength
integration
at
the
moment,
but
that
you
know
that's
something
that
it's
not
a
terribly
large
amount
of
work.
It's
just.
We
haven't,
there's
not
been
an
immediate
requirement
for
us
to
build
up
that
CashNet
implementation.
So.
C
So
so,
nothing
in
our
in
the
managed
instance
that
we
run
here
of
Taurus.
There
is
no
payment
mechanism
set
up.
We
don't
have
the
stripe
integration
even
in
place
right
that
was
actually
developed
for
one
of
our
Community
Partners
right.
That
is,
charging
courses
for
a
completely
different
instance
of
the
Taurus
platform.
C
A
And
thanks
Darren,
so
just
a
few
more
things
I
showed
publishing.
This
is
the
all
pages
view,
so
you
can
see
what
pages
are
in
your
course
and
then
we
have
insights.
We
have
this
lightweight
right
now,
ability
to
see
like
so
I've
actually
published
this
course
before
and
had
folks
add
and
work
through
it.
So
I
have
some
data
from
existing
course
sections
out
there,
and
so
I
can
see
at
a
glance
for
those
of
you
who
are
familiar
with
with
Echo.
A
E
C
Things
that
that
I've
wanted
to
run
through
so
maybe,
first
and
foremost,
one
of
the
things
that
we've
recently
re-implemented
so
in
in
proton
right
now,
if
you
within
your
course
project
as
an
author,
if
you
go
to
the
objectives
page
right,
the
objectives
you
you
can
Define
edit
and
manage
the
course
objectives,
your
learning
objectives
for
that
course,
so
that
that
view
has
been
re-implemented
this
again
right.
What
I'm
demoing
right
now
is
just
running
in
our
test
environment.
C
This
is
one
of
the
flagship
ship
Oli
courses,
the
general
chemistry
one,
and
so
this
is
actually
the
reason
why
we
had
to
courses
like
this
is
the
reason
why
we
had
to
rebuild
and
kind
of
enhance
this
objectives
view
because
they
just
place
a
greater
Demand
on
the
user
interface,
so
the
current
user
interface
and
proton.
It's
really
not
scalable,
to
support
a
course
like
this
General
chemistry
course
where
there
are
91,
total
top
level,
learning
objectives
and
I
think
probably
200
or
more
sub-objectives
or
skills
below
it.
C
So
this
view
now
it's
a
bit
more
similar
to
The
View
that
exists
in
the
Echo
authoring
environment,
where
I
can
see
a
top
level
objective.
I
can
drill
down
and
get
some
more
information
right.
I
can
see
what
pages
this
learning
objective
is
attached
to.
I.
Can
click
right
on
that
link
then,
and
that
will
take
me
into
the
editor,
for
that
page
I
can
see
the
sub-objectives
they're
that
are
applied.
I
can
get
some
statistics,
and
this
is
we
have
to
change
this.
C
This
is
like
great
text
and
a
gray
background,
which
is
not
at
all
readable,
but
it
you
know,
can
give
me
an
indication
of
how
many
activities
right
are
actually
being
targeted
by
the
collection
of
sub-objectives
in
this
objective
here
itself,
I
can
search
through
right
and
filter
down.
That's
surprising
to
me
that
only
one
objective
contains
the
word
Define.
Okay,
that
seems
a
little
bit
better
right.
I
can
page
through
the
objectives.
I
can
even
then
sort
by
right.
C
The
number
of
page
attachments,
the
number
of
activity
attachments,
so
that
that
gives
me
a
bit
of
what
we
refer
to
from
the
echo
platform.
Is
this
like
design
audit
capability
right,
I'm
able
Now
using
this
View
to
get
a
sense
of
how
well
I
may
have
constructed
and
instrumented
a
learning
model
across
the
course
curriculum
in
my
course
right?
C
So
if
I
sort
by
a
number
of
activity,
attachments
and
I
see
well
these
all
of
these
objectives
here,
Target
no
activities
in
the
course
that
gives
me
some
action
items
right
where
I
might
realize.
I
I
never
actually
finished,
setting
up
the
objective
attachment
to
the
activities
in
that
last
unit
of
my
course.
So
that's
the
new
learning
objectives
you.
E
C
E
C
Have
to
have
a
solution,
a
way
to
map
the
content
that
exists
in
the
in
the
Oli
pages
into
this
new
platform,
and
so
in
most
cases,
that's
a
one-to-one
mapping
right.
So
something
like
a
conjugation
table
that
element
in
Oli
that
very
same
element
exists
in
Taurus
right
and
so
just
in
the
last
one
or
two
months,
We've
made
a
lot
of
progress
in
that
space
and
have
kind
of
filled
in
a
lot
of
gaps.
A
lot
of
missing
content
elements
in
Taurus
to
achieve
that
one-to-one,
parody
and
I.
C
Think
we're
now
at
the
state
where
there
might
be
only
one
or
two
elements
that
we
don't
yet
support,
multi-panel
being
one
of
them.
But
let
me
I
can
give
a
quick
demo
of
what
some
of
those
actually
look
like,
and
so,
if
I
I
created,
this
latest
features
demo
course,
and
so,
while
I
I
so
I
lead
while
I
lead
the
Oli
engineering
team.
C
C
So
here
we
see
on
this
page
that
I've
authored
an
instance
of
a
conjugation
table
right.
So
here
this
and
to
edit
it.
The
interface
is
relatively
straightforward,
like
I'm
looking
at
what
effectively
amounts
to
a
preview
of
that
content.
That
piece
of
content
on
the
page
but
I
can
click
then
edit
to
change
any
aspect,
because
I
want
to
remove
a
pronoun.
For
instance,
right
I
can
do
that
and
then
kind
of
go
back
to
the
read-only
kind
of
preview
mode.
C
This
first
sentence
here
you
can
see
the
last
part
of
it
is
underlined.
That's
actually
indicating
that
the
there
is
the
presence
of
the
foreign
tag
right,
so
the
oi
dtds
allows
an
inline
foreign
tag
that
effectively
can
instruct
I
think
the
intent
is
to
instruct
screen
readers
to
handle
that
appropriately
and
there's
some
other
uses
of
it
of
the
Lang
attribute
as
well.
So,
but
that's
what
it's
indicating
here
is
that
I've
actually
attached
a
foreign
language
here
and
to
see
all
right,
I've
specified,
specifically
that
it's
French.
C
Now
we
also
have
support
at
the
course
project
level
itself.
One
can
Define
right
if
it
is
a
modern
language
course,
a
foreign
language
course
you
can
Define
what
your
target
language
is
there
at
the
top
level
of
the
project.
Then
any
instance
of
this
foreign
inline
construct
automatically
will
kind
of
inherit
that
default
language,
but
you
can.
You
can
override
it
on
a
case-by-case
basis,
so
that,
if
you
did
have
a
course
that
had
mixed
language,
English,
Spanish
French
and
you
wanted
to
designate
each
of
them
appropriately.
You
can
do
that.
C
D
C
C
Capability,
above
and
beyond
what
exists
in
our
production
system,
where
I
can
upload
the
the
closed
captioning
tracks
and
multiple
video
tracks
as
well
paired
with
that
is
the
support
for
what
the
Legacy
the
old
lidd
refers
to
is
command
and
messaging
right.
So
this
is
used
to
introduce
a
bit
of
automation
right
into
into
a
page
and
and
I
think
predominantly
one
of
the
one
of
the
the
I
guess
most
widely
used.
Cases
for
this
is
right.
C
C
Now,
there's
only
one
video
on
the
page
right,
so
I
don't
have
to
choose,
but
if
there
were
multiple
videos
here,
this
user
interface
would
allow
me
to
pick
which
video
I
want
this
button
to
specifically
Target
and
then
I
can
control
the
start
and
the
stop
time
and
then
I
think
I
have
to
go
to
preview
to
actually
play
it.
I,
don't
think
it
allows
me
to
do
the
pair,
but
if
I
preview,
this
page
right,
I
see
the
page
I
see
the
video
and
now
I
can.
B
E
C
C
But
we've
we've
got
to
the
point
now,
like
I,
said
that
we're
almost
at
100
content
element
parity.
That
multi-panel
is
a
very
unique
content
element
that
that
we
have
to
handle,
maybe
in
a
case-by-case
basis,
but
but
rest
assured
right.
If
you
have
an
instance
of
a
multi-panel
and
an
Oli
course,
there
will
be
a
migration
path
forward
for
that
content.
C
B
C
C
Aspect
that
I
wanted
to
show-
and
we
talked
about
this
Aaron
talked
about
this
a
bit
earlier-
was
that
ability
for
an
instructor
to
see
the
progress
of
practice
pages
right.
So
this
is
actually
a
course
section
for
that
that
practice
page
right,
I've
got
this
multiple
choice:
question
down
here
at
the
bottom.
C
That
then
I
could
look
at
my
enrolled
students,
and
this
was
just
a
a
course
section
that
I
opened
up
to
guest
access
and
I
logged
in
and
like
incognito
window
twice,
which
is
why
it
says
that
the
student
name
is
unknown.
But
if
I
click
on
this
second
student
I
can
see
right.
There's
two
pages
in
the
course
a
student
has
not
visited
this
new
page
course
right,
the
second
one,
but
they
have
visited
that
first,
one
right
and
they
visited
at
one
time
and
it
was
about
an
hour
ago.
C
So
if
I
click
then
into
that
page,
I
see
the
summary
of
their
attempt.
History
and
there's
only
one
attempt,
but
if
now
I
can
look
at
that
page
as
an
instructor
and
I
see
the
page
content,
but
I
also
see
exactly
what
the
student
did
right
so
for
this
question,
I
can
see
they
answered
question
Choice
C
and
got
it
incorrect.
This
drop
down
gives
me
the
full
history,
so
I
can
see.
Actually
they
took
four
attempts
right.
They
the
first
attempt
they
well,
they
click
C
again.
C
The
second
attempt
I,
don't
like
that.
That's
scrolling,
the
second
attempt
they
got
it
correct
right.
They
actually
clicked
Choice
a
and-
and
you
know
they
kept
trying
different
things
right
and
I-
understand
that
that's
actually
a
fairly
common
thing
that
students
do
in
practice,
Pages
clicking
the
different
options
right
actually
to
read
all
of
the
different
feedbacks
right
and
attempt,
maybe
to
learn
kind
of
you
know
something
above
and
beyond,
just
what
you
know
getting
it
right.
So
that's
that
is
the
new
feature.
A
Well,
excellent,
I'm
glad
you
guys
have
been
asking
questions
throughout
the
demo
and
really
appreciate
you
coming
today
have
a
great
weekend
and
I
guess
when
there
but
feel
free
to
reach
out
to
me.
For
any
reason,
any
question
or
ideas
that
you
have
feedback
that
you
have
I
also
want
to.
Let
you
know
that
there
is
no
December
community
meeting.
However,
next
year
we're
going
to
be
on
a
similar
schedule.
A
We'll
have
you
know
the
first
Friday
of
every
month,
but
we're
looking
to
do
some
more
interesting
things
like
you
know,
maybe
do
some
user
testing
and
and
other
things
that
that
might
help
us
get
these
move.
These
features
into
a
more
stable
state.
So
if
you
have
ideas
for
topics
that
you
would
like
us
to
tackle
and
have
a
meeting
about
next
year,
please
feel
free
to
drop
me
a
note
about
that
and
a
suggestion.
A
But
in
the
meantime
you
can
also
just
reach
out
to
me
anytime
and
for
a
one-on-one
conversation
or
to
talk
directly
with
any
of
our
developers.
So
with
that
I
will
say
have
a
great
week
have
a
great
weekend.
Everyone
and
I'll
be
talking
to
to
you
again
soon
and
make
sure
you
vote
thanks.
Mark,
yes,.