Microsoft 365 Community Microsoft Graph, 29 Nov 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Scale access to Microsoft 365 data with Microsoft Graph Data Connect

Description

Look at new ways to power business decisions with M365 Data & Synapse Analytics. In this 15-minute developer focused demo, Philip Li and Jose Barreto show viewers how to configure Office to share data with an Azure subscription and get back security and compliance insights regarding information oversharing inside a tenant. Configure Microsoft Graph Data Connect, set up an Azure Storage account and pipeline in Azure Synapse Analytics workspace. Use Power BI dashboard to deliver insights.

This PnP Community demo is taken from the weekly Microsoft 365 Platform Community call recorded on November 29, 2022.

Demo Presenters
• Philip Li (Microsoft)
• Jose Barreto (Microsoft) | @josebarreto

Supporting materials
• Article - SharePoint and OneDrive + Microsoft Graph Data Connect + Ignite 2022 | https://barreto.home.blog/2022/10/15/sharepoint-and-onedrive-microsoft-graph-data-connect-ignite-2022/
• Article - Gathering a detailed dataset on your SharePoint Sites | https://barreto.home.blog/2022/10/17/gathering-a-detailed-dataset-on-your-sharepoint-sites/
• Article - Four Options for SharePoint Site Analytics | https://barreto.home.blog/2022/11/01/four-options-for-sharepoint-site-analytics/
• Article - Links about SharePoint on MGDC | https://barreto.home.blog/2022/11/29/links-about-sharepoint-on-mgdc/
• Blog - Jose Barreto's Blog (step-by-step guides) - aka.ms/sharepointdata

Learn more
• Microsoft 365 Unified Sample gallery - https://aka.ms/m365/samples
• Microsoft 365 Platform Community in YouTube - https://aka.ms/m365/videos
• Microsoft 365 Platform Community - http://aka.ms/m365/community

A

B

So my name is Philip I'm, a senior product, marketing manager and part of the Microsoft graph data connect team, and today we're going to talk about how we can power business decisions with Microsoft 365 data and Azure synapse.

B

So the Microsoft graph is a massive Rich pool of data and we're talking about you know, 18 trillion data points that are generated by 300 million uh Office 365 users, and you know, like 270 million teams, users right. So it's a huge amount of untapped data that is available for analytics. So I wanted to today kind of take a little bit of a deeper dive into this and show you what's actually available.

B

So if we go to the next slide, you can see here a view of all of the data sets that are currently available through Microsoft graph data connect and it's a lot. So just what is uh Microsoft graph data connect. So we I just showed you like all of this data that is accessible through Microsoft graph data connect and what it does. Is it leverages M365 data at scale to empower insights and drive these different types of business decisions.

B

So, let's start by taking a look at, you know how people are leveraging this data that I just showed you and how customers are using, that data sets to empower analytics right.

B

So there's a lot of different scenarios and today we're just going to focus on the fourth scenario, and the fourth scenario is the security and compliance scenario on the bottom right. um So Microsoft 365 data can help. You understand how your employees are using and sharing sensitive information, and the demo today is going to be focused around the SharePoint information over sharing use case.

B

So, as you can see, each one of these scenarios are backed by several different use cases, and just because of the length of you know the time we have today we're going to go over one of them, which is the information over sharing use case that Jose will present and just give you a little bit more background about it. The SharePoint information over sharing is a security and compliance use case powered by our newly available SharePoint usage and activity. Data sets also known as ODSP data sets.

B

So this allows customers to better understand how Microsoft information protection labels are constantly protecting their SharePoint data, maintaining information boundaries and establishing new rules based on how sensitive data is managed and classified. So that just means like. If you are you know, if you send out an email like, are you sharing it with too many people? Is it being shared with more than you? It originally intended right, or is that information being shared outside corporate boundaries? So are people sharing it to their private emails? So this is actually something that Microsoft uses internally as well.

B

So uh we'd like to show you like how we kind of set it up and now I'm going to hand it over to Jose who will present the demo on the SharePoint information over sharing use case so feel free to take it away.

C

All right, so we are going to start the demo here uh in our office UI, where I'm going to go and navigate to the admin center right. So Indiana Center is where we are going to configure the Microsoft graph data connect. So you can get access throughout this data, so you you do have to set it up. We go under uh settings, org settings and you will find here the Microsoft graph data connect configuration.

C

So uh what we want to do here is basically to turn on the Microsoft graph data connect, which will allow us to transfer data from this tenant to an Azure storage account that you will configure- and we are also going to check the box for SharePoint online and OneDrive. So I am focusing here in the SharePoint scenario.

A

C

Sharepoint team- and one more thing to highlight on this page, is that when requests come into the Microsoft graph data connect, they do need to be approved, and this is where you would do it. For instance, there was a data request here and you can see that someone requested some data and you see what columns were requested. What kind of data sets so is this one is about SharePoint sites, so you can see that every request that comes in will have to be approved at least once now.

C

If you send multiple over time of the exact same request, then they can think go and function in a recurring fashion right. So next we are going to go here and look at our Azure account, so you will need to have an Azure account to store the data that you're going to receive. So basically, I have here server storage accounts which have a few containers inside and then I'm going to look here at my files sites folder- and this is how the data comes to you- a set of Json files.

C

So in this Microsoft graph data connect model, you don't actually do a request for each site, one at a time. You actually tell it give me all my sites and then it transfer to you files with all your sites in one single operation right. So let me go back and show you how this is done. So we are going to go here into the synapse Analytics.

C

Then I'm going to go into my workspace here and open the synapse studio. So this is where we are going to create the pipelines that will move the data from office to the Azure storage, so that you can use it with all the interesting uh Azure data tools that you have available to you. So let's go here and take a look at the integrate tab where you can see a few pipelines. So I have two different pipelines here we can take a look at a simple one. This one is as simple as it gets.

C

You have a copy data operation and you have a source- and you can see here, that the source for this data is going to be a Microsoft Office instance, and you you chose here. One of the data sets. So this one is about sites right. You can see all the columns you can select all the columns or just a few, and if you trigger this pipeline, then it's going to actually bring the data over.

C

How does the data look like, so you will go to your storage account and you will find as a result, something like this right, so you're going to have a Json representation of the in this case a sharing instance. So you see here, I have uh someone that shared a web called size experiment with full control shared with a SharePoint groups called size, experiment owners. So you can see here one sharing action, but uh what we are going to do we're going to bring that over to power bi.

C

So you can bring uh something you can build something like this, so you can bring that data into Power bi. So you should be familiar with this, and these are all the columns that are brought in. So you have information about size of each site. You have information about the templates that you use. So in this case you have mostly group sites, so we also have some personal sites and some site publishing sites, but uh the focus, as we mentioned, is in the information over sharing.

C

So if you want to build one of these, uh what you can do is you can go here and say: oh I want you to create uh my own Pipeline and you can go here and you say: I want to go and do a copy task and I'm going to do a source uh type, and you can select here all these and uh you select a connection in my case I'm doing source as office and then it it was going to bring the list of data sets that you have have available here.

C

So if you're going for sites, you would select this one. If you want information about sharing, you would select this one. So these bottom ones are are the three from our SharePoint collection. So let's uh go ahead and say this one.

C

And you can go and say: oh I want to get from the 25th to the 25th, so you select what dates you're going to bring over and then what is the destination so I'm going to say? Oh I want to put it in Azure data, Lake storage, Gen 2, and then you just select the path where you're going to lend this one.

C

So this would give you something very similar to uh what we had before, but maybe what you want to do is not to bring just one data set, but you want to actually combine this to understand security overall. So for that you will need information about sharing, combine this information about sites combined with information about active directory groups. So you can do group expansion so one way that you can do this is when you create this. You use our template that we publish to the gallery.

C

So in the synapse Gallery, you have several different templates that you can use.

C

If you simply search for SharePoint, you will find our Advanced analytics and insights for SharePoint and if I continue here, what this is going to do it's going to give us a template that brings all that data and then a couple of notebooks included to do the group explanation and combine everything together and in order to bring this over to your workspace, all you have to do is select the inputs, where you're going to link the service to your storage and to your uh office configuration. So let's uh go ahead.

C

Instead of doing this now, I have one that I already used so here it is. It basically shows you that you have three copy data here from aad and then we combine this using a notebook, and then you have sites sharing here and you combine these and then you finally drop the results in your storage, so this will go a long way to help. You understand how you would do this, and then you can customize this from the template.

C

If you look here, you can monitor the execution you have here, uh one that succeeded actually I'm running this on a recurring basis. So, every day it collects information, and you can see through this latest one here- you can see that it succeeded and you can see the several tasks that were executed, for instance, the site section. You can go here and see, for instance, that it got the data from Microsoft 365 to Azure data, Lake storage.

C

It took 26 minutes to do the whole operation and grab all the sites over, and you can also see that after they did those you had also a notebook, for instance, to do the AED group explanation. So you can take a look at that as well, and you can see here the notebook that we provided in the template. It has lots of comments, lots of explanations and all the code that we use to do the group explanation and drop the right data in the Right storage folder.

C

So this is how you would uh run these pipelines, but then, in the end, it lands in power bi right uh just pointing to the data that you have uh extracted. So you set up a dashboard like this one, so, for instance, this one will show you how much sharing is done at the folder level list level site level.

C

If you go to this one, you see how much sharing is being done and as full control as added three. So the different types of row, definitions and even some more complex uh information here, like the classification of the site, the sensitivity label highly confidential, protected Top Secret by the Target domain. So if you're in cybercam and you share data with control, so these are partner companies. So that's expected, but there's this acme.com domain here that I wasn't expecting.

C

So you can understand how this happened exactly what uh which of these sites have been shared with each of these uh domains. So a very detailed view of what you can uh um do in SharePoint in your tenant, all the permissions, which is something that is sometimes very complex to achieve. So if you want to actually run through this whole process, we do have step-by-step guides. You can go to AKA dot, Ms, slash SharePoint data.

C

All one word to find the step-by-step to both uh create a simple pipeline that brings just one of the SharePoint data sets or to do this whole template with lots of different data sets being pulled together uh for you and uh we're focusing on the SharePoint uh scenario here, but uh these steps will also help you understand how the whole thing works. If you want to do things, for instance, with exchange data with teams, data or even together with active directory and SharePoint.

C

So this was a quick demo out of how you can configure your office to share data with your Azure subscription and get all this insight about. What's going on inside your tenant,.

A

Excellent all right! Well thanks, so much for the demonstration on there. Some great questions in the chat, if you'd like to peruse those.