►
From YouTube: Latest on Microsoft Graph Data Connect
Description
During this 21-minute developer focused demo, Nik Charlebois shares a trick for extracting Microsoft 365 data at scale for analytics and insights reporting. Understand availability of current and upcoming data sets - data artifacts, i.e., user profiles, messages, events, chats…, in Microsoft 365 data. See 3 different Solution Accelerators (assemblage of data sets that together deliver insights for a particular need. ARM templates enable you to create your own Solution Accelerator. This PnP Community demo is taken from the weekly Microsoft 365 Platform Community call recorded on October 19, 2021.
Demo Presenter: Nik Charlebois (Microsoft) | @NikCharlebois
Supporting materials:
• Solution Accelerator - ProjectStaffing application | https://github.com/microsoftgraph/dataconnect-solutions/tree/main/solutions/projectstaffing
• Solution Accelerator - Conversation Lineage | https://github.com/microsoftgraph/dataconnect-solutions/tree/main/solutions/conversation-lineage#conversation-lineage
• Solution Accelerator - Watercooler application | https://github.com/microsoftgraph/dataconnect-solutions/tree/main/solutions/watercooler
• Solution Accelerator – ARMTemplates | https://github.com/microsoftgraph/dataconnect-solutions/tree/main/ARMTemplates
Learn more:
• Learn more about the Microsoft 365 Patterns and Practices community at: http://aka.ms/m365pnp
• Visit the Microsoft 365 Patterns and Practices community YouTube channel: https://aka.ms/m365pnp/videos
A
Hi
folks,
my
name
is
nick
schallebaugh.
I
am
part
of
the
microsoft
graph,
customer
and
partner
experience
team
with
brian,
and
today
we're
going
to
be
talking
about
microsoft,
graph
data
connect.
So
what
is
microsoft?
Graph
data
connect
well,
first
off,
when
you
think
of
the
microsoft
graph
ecosystem,
there
are
really
three
main
components
to
it:
the
first
one,
which
is
your
the
one
you're
seeing
on
the
top
left
of
this
info
infogram
here,
is
the
rest.
Apis
rest
apis
have
been
around
for
several
years
now,
we're
all
used
to
them.
A
In
most
cases,
right,
we
have
application
permissions
that
allow
you
to
go
and
grab
information
about
everything
in
a
tenant,
but
most
of
the
time
it's
going
to
be
around
revolving
around
specific
users,
then
in
the
top
right
corner
we
have
the
graph
connectors
which
allow
you
to
ingest
on-premises
data
into
the
graph,
and
the
bottom
part
is
the
focus
of
this
session
today,
which
is
the
microsoft
graph
data
connect
that
allows
you
to
extract
information
in
bulk
out
of
microsoft.
365.
A
the
advantages
of
using
microsoft
graph
data
connect.
Well,
the
first
one
is
the
data
at
scale
when
you
think
of
the
rest.
Api
rest
apis
are
not
really
built
to
be
able
to
go
and
extract
millions
and
millions
of
rows
of
data
to
be
able
to
generate
analytics
and
insights
microsoft.
Graph
data
connect
is
built
for
this
specific
purpose.
So,
when
you're
doing
microsoft,
graph
data
connect
exports
of
your
data,
you're
not
being
subject
to
troubling.
A
So,
for
example,
when
you're
using
the
rest
api,
if
you
want
to
go
and
grab
emails
for
everybody
in
the
organization
to
be
able
to
do
analysis
on
who's
been
interacting
with
whom
inside
of
the
enterprise
well
you're
going
to
be
limited
to
10
000
emails
per
user
per
per
per
hour
right.
That's
the
traveling
limits
that
we
have
when
you're
using
microsoft,
draft
data
connect
you're
going
to
be
able
to
go
and
get
the
information
about
everything
within
a
only
a
few
minutes
right,
so
you're
not
subject
to
trolling.
So
that's
the
first
part.
A
The
second
part
is
the
granular
content.
So
when
you
go
in
and
let's
say
what
you're
trying
to
build
is
exactly
what
I
described
there
you're
trying
to
get
insights
as
to
who
inside
the
organization
communicates
with
whom,
right
what
groups
are
talking
with?
What
group
more
often,
what
you
can
do
is
you
can
go
in,
and
you
essentially
define
a
contract
between
the
application
that
you're
running
that
will
go
and
extract
that
information
and
the
tenant
and
mint,
and
that
contract
will
define
a
few
things.
A
It
will
define
for
what
users
you
want
to
go
and
extract
information
from
right.
It
could
be
all
users
in
the
tenant
or
it
could
be
just
specific,
azure
id
groups.
You
can
say
I
only
want
to
get
information
about
emails
from
the
legal
and
the
finance
team,
for
example.
So
that's
the
first
part
of
the
contract.
The
second
one
is
the
list
of
fields
you
want
to
go
and
export.
A
Currently,
if
you
were
to
grant
an
application
that
uses
the
rest
api,
if
you
were
to
granted
access
to
read
information
about
emails
and
use,
something
like
mail.readall
by
default,
that
application
would
have
access
to
read
everything
about
the
email
that
includes
the
the
actors,
so
the
two,
the
carbon
copy
bcc
this.
It
will
also
include
information
about
the
subject,
the
body.
A
Yes,
we
have
a
male,
the
basic
that
the
read
the
basic
permission
that
will
filter
that
out,
but
you
still
get
everything
by
default
right,
whereas
with
microsoft
drafted
connect,
you
can
go
in
and
go
very
granularly
and
say
I
only
want
to
get
the
two
field.
I
don't
want
to
get
the
carbon
copy.
For
example,
I
don't
want
to
get
the
the
body,
the
attachments,
the
subject
and
so
on.
So
you
decide
what
fields
you
want
to
extract
right,
so
we
have
customers
that
are
doing
what
they
do.
A
Is
they
only
care
about
the
actors,
so
they'll
extract
the
two,
the
carbon
copy,
the
bcc
field,
and
we
have
the
opposite
as
well.
We
have
customers
that
all
they
want
to
know
is
the
sentiment
of
the
messages
that
are
being
exchanged,
but
they
want
to
filter
out
the
actors
right
for
privacy
concerns.
All
they
care
about
is
the
content,
so
they
do
the
opposite.
They
filter
out
the
two
carbon
copy
bcc
and
they
focus
on
the
actual
content.
A
So
this
is
what
gradual
content
is
inside
of
microsoft,
graph
data
connect
and
then
security
and
governance.
Once
that
contract
is
established
from
your
application,
you
submit
a
request
to
the
tenant
admins
to
go
and
extract
that
information.
The
tenant
and
mins
will
receive
that
through
what
we
call
the
privilege
access
management
portal
in.
A
And
they
can
review
the
list
of
fields
that
you're
asking
for
saying
all
right.
So
you
know
what
this
application
is
asking
for:
information
about
the
two,
the
bcc
and
carbon
copy
field
and
then
they're
asking
for
data
about
the
legal
and
finance
team.
But
I
know
that
the
ceo
of
the
company
is
part
of
the
legal
team,
so
I
can
further
refine
the
scope
of
the
application
and
say
yes
I'll.
Let
you
extract
information
about
the
legal
team
but
I'll
filter
out
bob
who's,
the
ceo
of
the
company,
for
example.
A
What
is
microsoft?
Draft
data
connect
concretely?
Well,
it's
a
component
of
azure
data
factory,
so
there
is
an
azure
play
here.
So,
in
order
for
you
to
use
microsoft
graph
data
connect,
you
need
to
go
and
deploy
an
azure
data
factory
in
your
tenant
and
microsoft.
Graph
data
connect
what
it
is:
it's
a
data
source
for
an
action
inside
of
data
factory.
A
So
when
you
data
factory,
when
you
you,
you
start
playing
with
this,
it's
essentially
think
of
it
as
a
visual,
almost
workflow,
where
you
would
go
in
and
you
would
do
your
extract,
transform
load.
You
would
say
right.
First
off
copy.
The
data
out
of
microsoft,
365
and
into
this
storage
account
then
take
that
data
massage
it
in
a
certain
way
and
then
push
it
somewhere
else.
A
Actually,
so
you
decide
how
you
want
to
do
your
azure
storage
and
in
order
for
your
pipeline
to
authenticate,
you
need
to
create
an
azure
id
app
registration,
so
we
only
support
authenticating
with
service
principle
right
now,
so
you
go
in
you
authenticate
your
pipeline
and
then
the
data
set
will
be
extracted
and
copied
over
to
the
data
lake
right.
I
think
this
needs
to
be
updated.
We
don't
actually
remove
the
data.
The
data
is
just
being
copied
over
now.
The
data
always
resides
in
the
client's
environment.
Okay.
A
I
was
talking
about
make
that
request
to
a
remote
tenant,
have
that
remote
tenant,
approve
the
the
the
contract
and
then
have
the
data
pull
down
into
the
isv
standard,
to
do
analysis
and
insights,
okay.
So
this
is
something
that
is
in
the
work,
but
right
now
the
components
have
to
exist
in
the
customers
tenant.
A
So
what
data
set
do
we
currently
support?
We
have
data,
sets
around
the
user
profile
right
everything
that
is
an
azure
id,
so
information
about
the
users.
What
their
office
location
is
what
their
phone
numbers
are.
We
have
oracle
information
so
who
the
managers
are,
who
the
direct
reports
are.
So
if
you
need
to
go
and
build
an
org
chart,
you
can
use
that
and
extract
information
about
all
users.
A
A
So
when
you
use
sent
item,
you
only
get
the
emails
that
your
employees
have
sent
out
right,
whereas
when
you
get
the
message
data
set,
you
get
all
emails,
even
emails
coming
from
outside.
Sometimes
there
might
be
spam
in
there
right.
So
we
offer
the
the
two
options.
Calendar
view
contact
mailbox
settings
right
if
you're
building
something
and
try
to
understand
all
right,
I
don't
know-
are
people
putting
out
of
office
right.
A
You
want
to
do
kind
of
a
cross
reference
between
the
calendar
events
when
people
are
booking
off
time
during
the
summer
and,
if
they're
putting
their
out
of
office
on
mailbox.
Sending
will
tell
you
about
this.
The
this
mailbox
has
the
out
of
office
activated
and
so
on.
Mail
folders.
From
a
team's
perspective,
we
have
teams
chat,
so
that
is
one-on-one
and
group
chats
right,
so
one-to-many
chats.
A
We
don't
have
teams
channel
discussions,
yet
this
is
something
we
are
working
on
and
then
on
the
far
right
from
a
sharepoint
online
perspective,
we
have
the
file
sharing
report
data
set
that
is
currently
in
private
preview.
So
it's
going
to
be
rolled
out
to
everybody
in
within
the
next
few
months.
This
data
set,
essentially
what
it
contains,
is
information
about
all
files
and
items
in
a
specific
site
and
who
it's
been
shared
with
internally
and
externally
right.
A
So
we
have
a
list
of
all
the
users
that
have
access
to
that
file,
all
the
groups
that
are
able
to
read
to
modify
that
file
and
so
on.
So
this
is
the
sharing
data
set
that
we're
about
to
roll
out
upcoming
data
sets.
So
those
are
data
sets
we
have
on
the
backlog
for
the
next,
I
want
to
say
3
to
12
months.
Okay,
the
first
one
is
the
group
membership.
A
The
other
one
is
the
everything
that
has
to
do
with
task
group.
Calendar
group,
emails,
meeting,
chats
right,
channel
discussion
call
records.
This
is
a
big
one.
This
is
around
all
right.
Who's
been
attending.
The
meeting
who
had
their
camera
turned
on
right.
This
is
big
for
education.
Folks
right
they
want
to
understand
what
students
actually
joined
the
meeting.
How
long
was
the
meeting?
What
documents
were
shared
during
the
meetings
and
then
meeting
transcript
is
another
one.
A
That's
going
to
be
very
interesting
when
you
think
about
doing
azure
cognitive
services,
on
top
of
it
right
text
analytics
what
was
discussed
during
the
meetings
highlight
automatically
highlight
certain
action
items
and
so
on,
and
then
usage
report
for
sharepoint
online
is
around
who's,
been
editing,
fox
trading
file,
deleting
files
moving
files
renaming
files.
You
get
the
idea.
Okay,
I
saw
a
question
there
around
sorry,
I'm
just
going
to
quickly
scroll,
so
tenant
tenant
migration.
This
is
not
the
purpose
here.
A
A
A
If
you
do
a
search
for
microsoft,
draft
data
connect
solutions
on
github,
you're
gonna
find
the
repository
where
all
those
solutions
are
stored
and
the
first
one
we
have
is
something
we
call
project
staffing,
so
project
staffing
is
something
that
combines
data
from
on-premises
hr
system
with
data
from
calendar,
the
messages
teams
chat
of
the
user.
So
this
is
the
by
the
way
the
github
repo
I
was
telling
you
about.
So
let
me
just
do
it
while
I'm
here,
so
this
is
the
get
up
repo
we
have
in
there.
A
We
have
a
section
called
solutions
and
you're
going
to
find
project
staffing
in
here,
and
we
have
all
the
instructions
on
how
to
get
started.
You
can
grab
that
code.
You
can
deploy
it
in
your
environment.
You
can
plug
it
into
your
own
data
source,
your
own
on-premises
hr
system.
If
you
want
to
and
then
feed
the
data
back
up
and
essentially
what
it
allows
you
to
do-
is
to
create
the
most
effective
teams
for
projects
and
essentially
so
what
I
have
here.
So
let's
say
I
want
to
do
a
project.
A
I
want
to
do
a
project
and
I
need
somebody
with
powershell
skills,
I'm
going
to
go
in
I'm
going
to
search
for
that
and
based
on
the
emails,
the
discussions
right,
we're
surfacing
entities
using
azure,
cognitive
search
as
their
cognitive
text,
services
text
analytics
and
we
know
who
are
the
powershell
subject
matter:
experts
in
the
enterprise.
So
let's
say
we
scroll
down
a
bit
and
we
go
to
joe.
So
if
I
take
a
look
at
joe
here,
I
can
see
that
joe
currently
is
available.
His
calendar
seems
to
be
fairly
empty.
A
Actually
because
he's
been
available
for
almost
six
months
now,
I
can
see
that
all
right,
so
this
is
a
skill
set.
I
want
to
add
him
to
my
team.
I
can
go
and
view
who's
part
of
my
team.
I
can
export
that
and
so
on
right,
but
this
is
really
showcasing
the
power
of
extracting
information
about
communications
and
surfacing
some
entities
with
azure
cognitive
services.
A
I
just
saw
jim's
comment
yeah.
This
is
the
demo
we
created.
People
were
more
busy
when
we
first
released
that
back
in
april,
but
yes,
these
guys
now
tend
to
be
fairly
available.
So
this
is
the
first
project
we
have
so
feel
free
to
go
and
grab
this
and
get
started
with
your
project
right.
You
can
deploy
that
in
your
own
environment.
We
have
all
the
steps
on
how
to
get
started.
A
So
essentially
it's
a
bunch
of
power,
bi
visualization
that
we
created
that
you
can
grab.
It
will
show
you.
For
example,
one
of
the
scenarios
we're
seeing
a
lot
of
customers
do
is
understanding
the
sentiment
of
their
customers
over
time
through
the
various
communication
channels.
Okay,
so
let
me
give
you
an
example.
A
So,
for
example,
back
in
april
customer
a
reached
out
to
me
and
based
on
the
language
used
in
the
communication
email,
the
sentiment
wasn't
that
great
right
like
they
were
not
happy
with
our
services,
we
exchanged
a
couple
of
emails
and
based
on
those
exchange,
you
can
see
that
this
overall
sentiment
increased
right.
It
improved
so
and
then
at
one
point
we
had
a
couple
of
teams.
Exchanged
and
sentiment
dropped
drastically.
So
what
happened
there
right
being
able
to
go
and
drill
in
and
try
to
understand
what
was
it?
A
Maybe
because
we
we
talked
about
a
specific
service
that
we
were
offering
that
they
weren't
interested
in,
and
we
were
a
little
too
pushy
right
so
try
to
understand
how
that
works.
So
this
is
something
you
can
go
and
grab.
The
third
accelerator
that
we
have
is
something
called
water
cooler.
So
water
cooler
is
about
figuring
out
the
best
time
for
people
to
be
meeting
right
based
on
events
right.
It
is
really
just
a
showcase
of
how
you
can
use
microsoft.
A
A
The
last
thing
I
wanted
to
talk
about
was
the
arm
templates
that
we
have
so
we
created
a
couple
of
azure
resource
manager
templates
for
you
to
be
able
to
get
started.
We
have
two
right
now
we
have
a
generic
pipeline
and
the
other
one
we
have
is
a
a
multi-tenant
data
copy.
So
essentially
what
it
will
do
is
it
will
deploy
all
your
components,
your
azure
data
factory,
your
pipeline.
A
It
will
connect
it
with
your
microsoft
draft
data,
connect,
microsoft,
365
data
and
then
once
the
export
is
done,
it
will
take
that
that
raw
json
file
that
was
created
and
it
will
copy
it
back
to
another
tenant
storage-
account
using
a
secure
access
token,
and
so
this
is
all
baked
in
so,
for
example,
if
you
go
in
these
are
all
one
click
deploy,
so
you
can
go
in
and
we'll
give
you
an
information.
So
all
right!
A
So,
if
you
go
in
here,
click
deploy
on
that
and
automatically
what's
going
to
happen,
is
you're
going
to
be
presented
with
the
quick
deploy
form
for
your
azure
template,
and
then
you
just
need
to
go
and
fill
in
the
information
right
so
fill
in
information
about
the
data
set
which
data
set
you
want.
So
those
are
all
the
data
sets.
I
mentioned
so,
let's
say
I
want
to
get
the
teams
chat.
A
I
pass
in
the
url,
the
app
id
app
secret
and
I
click
create
and
it
will
automatically
go
and
get
everything
deployed
in
your
environment,
so
you
don't
need
to
go
and
figure
out.
What
are
the
steps
to
deploy?
It's
one
click
and
everything
will
be
in
there.
That
completes
the
demo
part
of
this
this
here.
All
the
links
by
the
way
to
the
accelerators
are
in
the
the
deck
so
you're
going
to
have
access
to
that
after
the
session,
and
now
is
the
time
to
go
and
take
a
look.
A
I
should
have
mentioned
that
sorry,
not
yes,
right
now.
We
don't
have
support
for
gcci.
We
are,
however,
getting
close
to
getting
support
we're
working
on
this.
There
are
some
some
additional
technical
challenges
with
these
environments,
but
we
are
working
on
this
because
this
is
one
of
the
big
asks
that
we're
getting
from
customers.
A
We
are
we're
always
looking
to
have
a
chat
with
any
partners
that
could
be
interested
in
leveraging
mgdc
right.
So
if
you
are
interested
in
getting
more
information
on
how
you
could
use
that
as
part
of
your
application,
please
reach
out,
you
have
my
contact
info.
You
can
find
me
on
twitter
at
nicholabois.
The
challenge
is
always
to
start
my
last
name,
but
I
mean
more
than
happy
to
to
get
on
the
call
and
help
you
get
started
with
that.
But,
yes,
we
are
dealing.
B
Excellent,
I
don't
think
I
saw
any
other
questions
I'll
take
a
quick
scan
through
on
here.
I
think
all
the
rest
were
answered
and
thank
you
gladys
for
pitching
on
a
few
one.
Just
to
reiterate
that
was
in
the
chat
was:
does
the
azure
id
tenant
is
that
required
to
be
the
same
one
for
azure
as
the
one
that's
been
used
for
office
365
and
I
believe
gladys
confirmed
that
it's
true
yeah.
A
It
is-
and
this
is
one
of
the
things
as
well-
that
that
multi-tenant
scenario
right
I
was
talking
about
this-
is
one
thing
we're
hoping
to
solve
as
well.
So
if
you
have
multiple
subscriptions,
for
example,
or
you
want
to
export
to
a
different
azure
subscription
than
where
your
your
microsoft
365
environment
is
hosted,
for
example,
to
be
able
to
support
that.
But
currently
yes,
it's
a
one-to-one,
so
it
has
to
go
and
get
exported
to
the
same
azure
tenant.
B
A
I
wanna
like
just
elaborate
on
that
in
the
chat
in
the
meantime
I'll
take
gretchen
question
so
on
privacy
law.
So
right
now
we
are
we're
also
enforcing
geolocation
right.
So
when
you
do
the
export,
we
only
allow
you
to
export
the
data
in
the
same
geo
location
where
your
your
data
is
stored.
So
this
is
how
we're
enforcing
it
right
now.
So
this
is
why
it's
going
to
be
kind
of
a
challenge.
B
Well,
thank
you
so
much
nick
and
gladys
as
well
in
the
wings
helping
answer
the
questions
on
the
side
really
appreciate
getting
to
see
microsoft,
craft
data
connect
and
a
number
of
different
scenarios
that
helps
address,
especially
the
solution
accelerators.
It's
great
to
see
some
kind
of
pre-made
kind
of
suggestions
for
how
to
use
the
data.