Microsoft 365 Community Platform, 26 Sep 2023

Previous Meeting

Next Meeting

⏯

youtube image

►

From YouTube: Microsoft 365 & Power Platform weekly call – 26th of September, 2023

Description

Microsoft 365 & Power Platform community call on September 26th 2023. Recap on news and updates from Microsoft, followed with demos by the community.

✨ Call included three demos:
• Dan Wahlin (Microsoft) | @danwahlin - Use Azure OpenAI and GPT prompts to convert natural language to SQL
• David Rousset (Microsoft) | @davrous - Building dynamic 3D worlds in a collaborative way using Microsoft Teams AI
• Kishor Subedi (Microsoft) – Develop and Contribute to Power Automate Designer

Q&A takes place as always in chat throughout the call.

💻 Screenshot summary for this call | https://warner.digital/ms-speakers-summary09262023/

👏 Host:
• Vesa Juvonen (Microsoft) | @vesajuvonen

📃 Agenda
00:00 Introduction
03:27 Request to present
04:11 Assets and materials
05:29 Sharing is Caring
06:32 Community badges
07:18 Events
09:01 Latest news from Microsoft
10:01 Picture time with Together Mode!
11:31 Dan Wahlin (Microsoft) | @danwahlin - Use Azure OpenAI and GPT prompts to convert natural language to SQL
28:40 David Rousset (Microsoft) | @davrous - Building dynamic 3D worlds in a collaborative way using Microsoft Teams AI
42:47 Kishor Subedi (Microsoft) – Develop and Contribute to Power Automate Designer
55:06 Closing

📰 News
• Announcing Microsoft 365 Copilot general availability and Microsoft 365 Chat - https://www.microsoft.com/en-us/microsoft-365/blog/2023/09/21/announcing-microsoft-365-copilot-general-availability-and-microsoft-365-chat/
• How to transform work with plugins for Microsoft 365 Copilot and AI apps - https://techcommunity.microsoft.com/t5/microsoft-teams-blog/how-to-transform-work-with-plugins-for-microsoft-365-copilot-and/ba-p/3933467
• Deploy frontline dynamic teams is now available in public preview - https://techcommunity.microsoft.com/t5/microsoft-teams-blog/deploy-frontline-dynamic-teams-is-now-available-in-public/ba-p/3932854
• “Communities in the enterprise” 🎙 – The Intrazone podcast - https://techcommunity.microsoft.com/t5/microsoft-sharepoint-blog/communities-in-the-enterprise-the-intrazone-podcast/ba-p/3929225
• Announcing Microsoft Graph CLI v1.0.0 release candidate, now with beta support - https://devblogs.microsoft.com/microsoft365dev/microsoft-graph-cli-v1-0-0-release-candidate-now-with-beta-support/
• Retirement of Exchange Web Services in Exchange Online - https://devblogs.microsoft.com/microsoft365dev/retirement-of-exchange-web-services-in-exchange-online/
• Public preview of new custom connector enhancements - https://powerapps.microsoft.com/en-us/blog/public-preview-of-new-custom-connector-enhancements/
• Streamline your governance and environment strategy using Default Environment Routing (preview) - https://powerapps.microsoft.com/en-us/blog/default-environment-routing-public-preview/
• Introducing the Power Automate plugin for ChatGPT - https://powerautomate.microsoft.com/en-us/blog/introducing-the-power-automate-plugin-for-chatgpt-2/
• Power Platform Global AI #HackTogether Keynote Recap and What’s Coming - https://devblogs.microsoft.com/powerplatform/power-platform-global-ai-hacktogether-keynote-recap-and-whats-coming/

📝 Learn more
• Download invites for the community calls at: https://aka.ms/community/calls
• Volunteer for a demo in these calls: https://aka.ms/community/request/demo
• Integrate OpenAI, Communication, and Organizational Data Features into a Line of Business App | Microsoft Learn - https://aka.ms/openai-acs-msgraph
• davrous/JARVIB: Just A Rather Very Intelligent Bot that can create dynamic 3D worlds using Teams AI Library (github.com) - https://github.com/davrous/JARVIB
• Getting Started | Azure Logic Apps UX Docs - https://purple-pebble-0e11de71e.1.azurestaticapps.net/
• https://github.com/Azure/LogicAppsUX

• Sharing is Caring initiative: https://aka.ms/sharing-is-caring

💡 Learn more about the Microsoft 365 & Power Platform community
• Microsoft 365 & Power Platform Unified Sample gallery - https://aka.ms/community/samples
• Microsoft 365 & Power Platform Community in YouTube - https://aka.ms/community/videos
• Microsoft 365 & Power Platform Community - http://aka.ms/community/home

Sharing is caring! You are awesome! 🧡

A

B

Welcome everybody: this is Microsoft 365 Empire platform, a weekly Community call, and this is the goal where we always have Microsoft speakers. Well, typically, we have certain exceptions every now and then and some exceptions actually coming later in this fall as well. uh My name is I'm a principal product manager on the Microsoft, 365 platform areas and I'll, be your host today. Now uh we'll start with a typical set of agenda, so we kind of do a quick, quick uh English is so hard. Quick recap on all of the things.

B

What what is available for you to get us started on building experiences within a Microsoft, 365 and Power Platform as well, then we cover the latest news across Microsoft blocks. A lot of lot of news. Actually, this week uh more focused, obviously on the big announcement, especially in Microsoft 365 site related on co-pilot. The the AI stuff has been more available on the Power Platform uh before this, but now it's also coming on the Microsoft 365 site.

B

Then we'll do the group photo uh together with those people who are willing to enable the camera, and then we go to the real stars of today. Who are Dan, Walling and David will stay and Kishore supedy, so nice balance of AI, stuff and some metaphor stuff and cools 3D words worlds, and then power automates, our stuff as well. So a lot of a lot of cool Demos in the agenda today. Now, let's do a quick recap on assets which are available.

B

We're not going to spend too much time in here, but we have our YouTube channel available where you can always check the recordings afterwards and individual demos. We do buffers at least the one demo video every single business day within that channel, including Thanksgiving, because it's a business business. It is a business day outside of U.S and from there if you want to subscribe and stay up to date on what's Happening custom, Microsoft, 365 and Power Platform.

B

With this awesome demos, uh partly provided by you, we also have the LinkedIn group discussions and updates to stay up to date on what's Happening, we have a lot of Open Source assets available, but as it might be a bit difficult to find the relevant sample for you directly from GitHub. We have this centralized sample galleries available, which is targeted for a specific assets, and there are a lot of other facets: uh assets and URLs available. So Luckily everything is aggregated to this.

B

One URL, which is the akms forward, says Community forwards, that's home, so go there. You will find all of the different awesomeness which is available for you to take advantage. Now we do have quite a few different Community calls, and this is the Tuesday Community call every single Tuesday in Pacific time with system Microsoft presenters.

B

On top of this, we have the Empower platform and of a science monthly Community calls Power Platform, especially, is for Community presenters, which is really really cool, and the same applies for the the bi-weekly course, which are the Microsoft 365 and Power Platform Community call and Viva connection SharePoint framework call those are happening. Every single Thursday, 7 A.M Pacific time so either one of the those calls every single week.

B

That does mean that every single week we had to have at least two different Community calls, which you can stay up to date and join and have funds with the fund with other people. In the community, now you don't have to turn on all of those calls. You can catch the recording afterwards and please take advantage of our Meetup setup where you can always go and double check.

B

What are the agenda items for the upcoming course, so you don't have to kind of want join on the course and be like eh, not the interesting agenda items for me, you can actually see those as you sign up for the Meetup service, which is the link uh coming forward.

B

Slash Community, forward, slash Meetup now I did mention that some of the community goals are for Community demos, and this is a great way for us for learning each other so, rather than just Microsoft explaining to you how we're designing things to be used, and it's actually really really valuable for seeing how people are implementing things in real world and that's the opportunity here as well also a great way of getting MVP status if you're interested on that or getting a practice and and exposure for the community as well.

B

So please do sign up if you're interested on presenting. We will help you all the way uh from even from a title descriptions and and also presented presentation reviews if needed, if you're volunteering uh for these demos, akms forward slash Community, forward, search, recast forward demo. Now we do have a lot of assets available for getting started in Microsoft 365 Cloud.

B

We have the Microsoft traces to have developer Channel, where you can subscribe, Microsoft racist developer program where you subscribe, and then you will get a free, Microsoft, 365, developer, return on for every single 90 days and three news automatic take as long as you use it for developer purposes. On top of that, we have a lot of learning material, which is evolving all the time. We also have our podcast and video series happening across the Microsoft trees. This five Power Platform.

B

So we have the BMP weekly show we have the Mondays at Microsoft show with Caravan and header. We have the Power Platform connections with Hugo and David, and we have the Microsoft 365 developer, podcast, together with Jeremy, thick Paul, shuffling and Aisha boss, so really really good great opportunities of catching up on what's happening within the ecosystem.

B

Coming back on the samples we mentioned that there's a lot of them there's actually more than 1700 samples available within this one, centralized location, we're trying to make it as easy as possible for you to find a relevant sample from the Microsoft provided samples or from the community provided sample. So if you go to the akms force, has Community forces samples you can go there. You can easily find all of the goal samples which are getting uh shared with all the community members.

B

Now, as you find the sample, you might be okay, now I'm in a GitHub. What does that mean? Oh, oh my God, or coming back on the thing that you want to present, but you're not quite familiar on how to get presented. We cut you covered and David Warner is on the call explaining what is sharing is caring and how it can help you.

B

A

Thank you, vesa friends. We are so excited for sharing and scaring because, as you well know- or maybe you don't know it's a program- that's here to provide Hands-On guidance. What does that mean? It means we're going to join. Live teams. Calls together, walk you through how to do things like pull requests and forks and branches. What are all these things? We're going to explain it we're going to work through it together, you're going to leave, feeling, confident and comfortable and ready to tackle the community world so free of charge. Aka.Ms sharing is caring.

A

We've got a Power Platform samples contributor, scheduled in October just a week after the Power Platform conference. So, as you go, learn all those exciting new things you are going to want to come back and contribute and we're going to be there for you, safe space, no recording ask any and all questions you want and we just had a live stream yesterday that recorded that exact session, so we'll be starting to share that out.

A

If you want to get it as a preface to some of these live calls, so you can still get those hands-on experience now, once you have contributed, we absolutely want to recognize you for the work that you are doing in the community, and that is where our recognition program comes in powered by credly you get cool badges we've got new ones coming up like our pumpkin spice.

A

A lot of commits and Oktoberfest is right around the corner next week, actually is October, so get those commits and pull requests already, because we've got some fun and exciting new badges for you coming up at the end of this year, so uh absolutely free of charge. We cover the cost, AK dot, Ms, slash, Community recognition, vesa back to you in Finland.

B

Excellent, thank you. Allied you're speaking faster than I do today. So I need to really speed up the discussion so.

A

That everybody can actually follow up.

B

On whatever or maybe I'll switch to Phoenix, just for the sake of it, no just kidding now, uh let's recap quickly uh on all of the big events which are coming up. So first of all, at 365. Educon is happening uh three times in a year and two of them are already done. Chicago is happening: October, 13th to November 3rd, um a really really great opportunity and the northern American side uh for joining a meeting of the community.

B

Now next week we also have the Microsoft 365 Power Platform conference happening in Las Vegas at the MGM Grand opportunity. A lot of people are already signed up and registered. There seems to be a great great uh event. Coming up there uh awesome to see the pictures from there next week now, a bit later uh in the November. We also have the Microsoft ignite coming up at the Seattle and Seattle Convention.

B

Center I've been there so many times within my past career uh within a Microsoft and the great opportunity again meeting up the latest uh catching up on the latest from Microsoft meeting, Microsoft people and other community members, and then we wanted to remind next to Spring, April, 13th, May, 1st and 2nd. We actually have the Microsoft 365 conference coming up at Orlando.

B

You probably want to mark your calendar on that one already, so that you're able to take this into account in your next calendar year budgeting, because the budgeting season is starting pretty soon as well good. To be aware of that. Now, on top of these there's a lot of a lot of different other community events happening, for example.

B

This week we have the call of days national museum of computing, betsley Park happening at betsley UK, just a good example of a free community event where people can go catch up with the latest, what's happening and and talk with other community members and Microsoft employees as well. A lot of those are happening throughout the world. Please have a look on the full list of events at communitydays.org.

B

Now quick recap on the news side of the house: a lot of flight of news this week, we're not going to go through all of them uh just going to call out for Microsoft 365 site. This was a big week. Last week we announced the Microsoft threes is took out: 365 co-pilot, uh General availability coming in the first of November, uh together with Microsoft 365 chat, so really real cool opportunities uh for customers, and also there was a great blog post related on how to transform work with plugins for Microsoft 3s S5 copilot.

B

So how do we can build your custom plugins for Microsoft 365 Cobalt as a partner or as a customer? So take your business data or lob data or isv data in the context of that AI through Microsoft racist, like Cobalt, really really cool scenarios over there? The copilot GA, as mentioned, is happening on first of November other than that a lot of other cool announcements happening across the different areas, so we're going to kind of list all of them. Thank you, David for pasting in the links within the chat now before.

B

We then go to the actual stars of today. For the demos, let's do a quick crew photo I'm a bit. uh I was supposed to actually adjust the view already, but let's see uh we can do that still, so let me go to together mode I will track and drop this in a minute in a second there we go, you can actually see the screen. Now we are Pixel Perfect right now.

B

This is looking cute. uh How do I change the scene today today is in here, okay cool uh every single day, the buttons are in a different location sounds familiar right. So here we go uh a bit of a different thing: uh cool, looking hats on the top yeah, that's actually really cool. We still have few seats on the room. I will start Camtasia recorder, one second, for that one there we go and I guess we are starting to be ready to go.

B

I will put myself in the picture as well and then it's on pixelated. No, we can still do this. It's okay! It's a bit! Pixelated, it's a real world and let's do some. Everybody will capture a cliff animation. Out of this, we can still I can still recognize a lot of familiar faces uh in the screen as well. Excellent, brilliant, thank you for having thank you for joining on the community and talk in the middle. Yes, we have dogs on the middle excellent and there's the Pixel Perfect surrendering again awesome.

B

Awesome thanks everybody for joining uh on that and the picture is at the dock for smiling as well. That was really good cool. Let's then go to the real stars of today. So we'll start with Dan, and then we go to David and then Kishore um cool cool cool demos coming up today, but then I think you are ready to go right.

C

I, am it's good to be back folks? They said thanks for having me again and uh for those that haven't been with us, we're doing a whole series that I'll walk you through today we're going to talk more about Ai and today's theme is going to be just because you can doesn't mean you should so I'll explain what I mean. uh So for those that don't know me, my name is Dan walline I work with our Cloud developer. Advocacy group and I'm excited to talk with you again.

C

So let's Jump Right In here since I have a limited time.

C

So we're going to talk today about assisting uses with AI, and this has been the theme for a bit and we have five General Sessions we're covering here um today we're going to talk about one, that's a little more interesting and I'll, explain what I mean by that and that is using Azure open, Ai and GPT prompts to convert natural language to SQL.

C

Now I'm gonna give a little story to to start this uh I. Well, second, job I guess I had had the opportunity to work with uh DBA. His name was Lance. uh Super I owe a lot of my career Lance because he walked me through all the security implications and how to get you know, stored procedures and tables right in in SQL Server things like that. So I spent many many years working in the world of databases and then moved on to Consulting and did it you know even more there.

C

So the reason I mentioned that is some of you may be in that role, where you're not only doing the development side, but you also have to handle maybe some of the database side, and you know about some of the security implications. So what we're going to talk about here is what you could actually do with something like Azure, open, Ai and use it to be more friendly to users. But there might be a few things you want to think through. So before I jump into the rest of that.

C

Let me walk you through what we're covering again, so we started off, and these are all recorded if you missed them uh with introducing the sample and the general concepts we're going to be talking about three General pillars. uh The first is AI communication and then organizational data is the other one. So uh last week, I went in to create an Azure, open, AI resource and deploy a model showed how to use Azure, open, AI studio and a few other things again. It's all recorded.

C

So don't worry if you missed it, but today we're going to cover this natural language to SQL and then the next two weeks are going to be some more on AI and actually my colleague, I chabash is going to help me out here and she's going to be taking the next two weeks. Now, once we get through those we're going to get into communication features, this will be Azure communication Services talk about adding phone calls, SMS messages, email things like that to apps, and then we'll wrap up with bringing organizational data.

C

This will all be with Microsoft graph and Microsoft craft toolkit and some of the new things you can do specifically with Microsoft graph toolkit now I'm going to call this session, though the just because you can doesn't mean you should session, and this is done on purpose. um The tutorial I'm going to point you to at the end today actually has this in it, so you could go through step by step, but, as we talk through this today, we're going to talk through some of the uh I. How should I put it dangers?

C

I, guess that you should really think through before you jump into something like this now. Let me uh move back over here to the app and for those that haven't seen the app before it's a really simple line of business. App with the data grid does have some security with login has multiple AI features. uh Communication features like I can actually call phone numbers from the app send SMS messages. Things like that, but today we're going to talk about this good old data grid I mean who doesn't have a data Grid in their.

C

uh You know app at some point um check out the customer query here: get the total revenue for all orders Group by company and include the city. Okay, let's go ahead and run that now before I hit the button. I want to mention that this is a postgres SQL database. So it's a relational database and it only has a few tables. So this is a demo. This is not ready for production and we're going to talk through some of the gotchas here, which is the whole purpose of this.

C

So it generally has customers, orders and reviews. Three main tables and I'll show you how that works coming up. So when I run this we're actually going to use Azure open AI to translate this sentence or sentences into Dynamic SQL. Now that should ring some warning bells for some of you at least I hope it does. But we are accounting for quite a bit and I'll talk about that. But this is one of those opportunities that you look at it and you go.

C

Oh, my users would love that, like that's amazing and then, if you don't have that background in you know securing databases and queries, and things like that, that's when you may might be walking down the danger zone if you've seen Top Gun the movie but anyway, so here's an example of what it just did. So let me uh reset the data. I'll run it again and there you go as you can see, it's it's pretty fast. Actually, none of that was cached.

C

Now, let's do um get all reviews from companies in Let's see we have New York, Austin, Sydney, London you'll see right here. Let's do London, let's see what that does and all right that it worked, but let's say uh include the company name: let's go ahead and run that all right, that's a little better! Now we have the company uh the review, it's a one through five scale. Those type of things date comment things like that. Now, there's a lot more.

C

We could do on this, but what I want to show you and spend the rest of the time on is what's going on and some of the gotchas and the just because you can doesn't mean you should all right. So, let's jump into that. So first off you'll notice down here at the bottom of my uh UI I, have the console open in vs code, and these are the actual queries that are being returned from Azure, open Ai and you could use this with open AI too, by the way so select.

C

uh C dot company uh r dot star from customers enter join the reviews where City now. This is good, though so we're doing. Parameterized queries, okay, so that can get rid of our SQL injection type attacks. That's the first thing, you'd have to worry about here um and then it looks like we have a very similar one right down here and if I scroll up you'll see some of the others. uh Let's see that's the reviews.

C

One yeah here we go select the company City the order total from the revenue uh inner join on orders Group by company and City. Okay, so pretty standard SQL queries right now. Let's talk about the just because you can doesn't mean you should, though so. The first thing is this is the the function.

C

This is the API that's being called so the client side sends that data that you saw right here down in the text box and it sends that up to an API in this case it's a typescript API, but we're also going to have uh c-sharp and python pretty soon, but you'll notice. This gift, SQL from NLP natural language processing, is what that stands for now. What this does is it reads from a schema, and this is a very high level schema. Actually, this is it right here.

C

You could certainly go way more detailed, but this basically is on the server side, making it aware of what are the tables? What are the columns and those type of things? Okay now, obviously, this is not something you'd ever want to share outside of a secured environment. Okay, so this would stay on the API side that we can take care of easily now moving on down, though we have two prompts here.

C

So what we're going to do is we have what the user wants to do, but we need to set up some ground rules and we're going to do that through this system prompt. It's called now the system prompt. Think of that, as all the rules that openai needs to follow in order to get back the data that we would like to get so notice, it's a natural language to SQL bot that returns only a Json object and the parameter values in it and the SQL is going to be against a postgres database.

C

And then we say here is the schema and we embed that schema in there now this is kind of gotcha number one with Azure open, AI. All right. You have all the security, all the uh responsible, AI rules around this, the guarantees that we provide with some of the others out there you don't so you would be sending that schema up and it could be used for training all right. It would not be in this case, because this is azure open, AI, but I do want to point that out.

C

You have to be careful, as you send, prompts up whatever you're using because there's a lot of Open Source models out there that can be used now, there's obviously uh the Azure open, Ai and others. Are they using your data for training purposes? So that's something! You'll always have to ask, especially in business scenarios like this now in this case we're okay, because I am using Azure open AI. Now some of my rules convert any strings to a postgres, parameterized query: okay, that's good! That can invent uh prevent SQL injection attacks all right.

C

If you're not familiar with those, it's a lot of hacks. You can do bad things to uh I, don't know drop databases, drop tables things like that if people embed actual strings into a SQL query and then execute it dynamically now, those of you that work a lot with databases- you know exactly what I'm talking about, but if you haven't definitely something to look into look into SQL injection attacks, not a good thing, so this prevents the pre. This prevents that type of thing with the parameterized query- and you saw that earlier.

C

If we go back down to here, let's go to the bottom and right here so you'll notice that dollar one and then we're passing this in so the database will take care of that in this case.

C

Okay, now, let's move on, though, because there's more things you need to worry about, and we in this case this could call it one shot or multi-shot fuse shot. These are samples of what it might look for so display all company reviews Group by company. Well, this is what we want the assistant to actually return uh back to us. Okay, so notice we have a SQL in the Json SQL property, and then we have our param values. Well again that matches. Let's go back to here with what you see right here all right.

C

This is the actual raw SQL, the Azure open, AI returned. So we have the SQL property, there's our SQL query, and then we have the params values, which is an array of the parameters that would be substituted in okay, so move on to the next part. So we have a couple samples here we say converting any strings to parameterized query now, didn't we just say that I'm pretty sure we did right here.

C

Okay, there is the concept of most recent bias when you work with prompting in Ai and in really really important rules that you want to follow. It is common that you might actually list those at the beginning and then list those again towards the bottom of your prompt and the reason for that is, depending on the models that are being used, they could be trained on. You know a lot of data out there and by kind of reminding them last thing here, convert any strings to postgres parameterized queries.

C

It's a good way to make sure it's like top of Mind as the model does its work, so something to think about. As you go through this now you'll notice, another one do not include any text outside of the Json object. Well, guess what happens occasionally, occasionally I won't get back this raw Json and that can really mess you up if you're looking for raw Json and then parsing that so I actually have some extra post processing code, because sometimes it will say, here's your SQL query and then it'll embed the Json.

C

Well, the here's, your SQL query is not a good thing, because if you take that as that's what I need and then you try to do a Json parse on it not going to work so you're going to have to worry about that and that's another kind of gotcha with really any AI model out, there is make sure you double check the data that you're getting back all right and then from there. What we're doing is we call open Ai, and this is just a fetch call.

C

We pass in this prompt that you see here and we also pass in what the user typed and, of course, that is what you see right here. Okay, so so far, we have this system prompt. We have a user prompt, we're going to send all those up with these rules. Is that enough I mean we have parameterized queries right, no still, not enough um a lot of security implications to think about.

C

If, for those of you that deal with stored procedures, for example, or just procedures, in some databases, we can lock those down to certain groups. If you will now, we have to kind of run this as permissions that the app has not nearly as granular or we could run them as permissions out of the user. Okay, that would be more granular that is not built in here.

C

So that is absolutely another thing you would need to think about, because what, if they try a query that most users are allowed to get to this table, let's call it table X, but not all users, all right. We need security for that of course. So some more things to think about now, what I do once we get the data back is uh we go through and the open AI will actually extract the Json, so it'll make sure there's no other text and extract it, and if it can't then return an empty object.

C

We then parse those Json results and then notice what I'm doing here, though, all right is prohibited. Query could I come in and do this drop table customers all right, something like that! Well, yeah I could now, hopefully the security would not be allowed to even allow that to run but yeah. It's a possibility. Notice. I get prohibited query here and again. This is the just because you can doesn't mean you should you're really going to have to think through.

C

This is a really simple thing: I did I just threw in a bunch of keywords that I would never want in this case, and you can see an example here of those and then I checked does what the user typed have any of these keywords.

C

All right now is that enough, I'm gonna argue no, um there's still even more thought that would need to go into this, but I'm out of time, I'm going to move on here, so I want to wrap up with again just because you can doesn't mean you should that's a super cool feature.

C

It's also a feature you would really really have to think through and that's the whole emphasis, and that is going to set us up for the next couple weeks of AI, where we're going to talk about some some scenarios that are generating Dynamic SQL, not nearly as dangerous as that, um but to wrap up. If you want to learn about some of the some of the other areas, you might want to think about from the security to what we call post processing.

C

That's uh checking for band keywords, for example, and the list goes on and on and on, then you can check out this tutorial if you scan this code or you can go to this link right here. This will give you some insights into that, and it's actually going to walk you through not only setting up the Azure open, AI, but also it'll walk you through that exact demo. That I just ran with all the caveats of just because you can doesn't mean you should I'll leave you with that and next week.

C

Aisha is going to be here for the next two times on AI. So I look forward to that with that uh Visa I'll turn it back over to.

B

You excellent thank you Dad. Thank you, Dan, really, cool, uh awesome storytelling as well points for that additional points, so really really good. A lot of a lot of discussion on the chat related on uh AI based um SQL injections. This one was good awesome, awesome stuff. Now the next we have David's Russo who's, going to talk about building Dynamics 3D worlds in the collaborative way using Microsoft teams, AI David, really combining then Ai and metaverse. Is this what we're talking about.

D

Yep, thank you so I'm going to share my screen up. You can see it normally yep. We.

B

Got it take it away.

D

So thanks Dan, because uh you've been able to introduce some concept I'm going to reuse in this demo. So first let me show what the demo is doing and you can also have access to the code on on GitHub, which are the link. So the idea there I wanted to build my custom copilot using the team's AI Library. So the teams, AI library, is really a new way to build a bot based. You know, application in teams and use as European AI or open AI to help you to do some tasks.

D

It could be a smart board, but it could be also something to help you generating code. So it would be in the continuity with what we'd have seen with done: I'm not going to generate a SQL, even if I would need some help to realize SQL. To be honest, I've always been super bad in SQL, but we're going to generate code. That's going to create Dynamic 3D World inside teams, so I am inside the teams meeting I loaded, my Jarvis, so it's a reference to Jarvis.

D

um He knows. Jarvis means something specific I, don't know. If you know what Jarvis mean, but I decided to change the last letter and I'm going to share to the meeting stage, um this 3D canvas, so the 3D canvas um is using Babylon GS, so 3D engine I've been creating. I already did some demonstration if you're following me, using this engine and now I can add to my button, which is there some specific actions. So, for instance, let's ask jardeep to Let's.

D

Imagine I would like to create 10 cubes of different colors and put them on a circle, so I'm going to ask Ravi to create thank you of different colors like on the circle, for instance, I hope my boat is still running. Fine. You see that he's going to contact my uh my birds and boom I managed to have now 10 cube of different colors, um uh but like on the circle, you can even check the code there that is being generated.

D

So it's babylon.js code and I'm, taking the JavaScript code and I'm going to evaluate that in a dynamic way. I'm going to show you the magic behind that, um of course, meaning that I can continue. For instance, I would like to ask jardib: can you please I, don't have to say trees, which is great I, don't I'm, not sure it's a good idea to be rude to AI. Maybe one day we will pay that. But can you please animate the rotation of the cube five and nine?

D

So, let's see what's going to happen.

D

And you can now see that this Cube and these Cube, that are probably Q5 and 9, are now rotating- are now animated, which means that yeah I managed to also understand the the you know which object I'm talking about. We can't even do something very fun. We can chain like some ass, like um make Cube for transparent.

D

um Two time bigger and move it up by um I, don't know two units, it's not always working perfectly well but like so far, I've been lucky. So what is going to be keeper? You see it worked, so he managed to do like to change all the action, and this show me the code.

D

um I've got all the other possibility. I can have a list of models, so you know in PowerPoint you can load 3D models. You can insert 3D models so I'm using the same API, so I'm going to ask to find available models.

D

For her house so 3D models, so this time is going to do something different, like he's going to understand, like my intent, is to have a list of models so we're going to transform my prompt into a specific code to another part of my code. It should then call the API of um of you know of PowerPoint in a way and then generate by an Adaptive card list, to show me the list of picture in a way like the 3bd 3D model available.

D

So you see now, I've got a list of available model and I've got their name, but what's fun like this is something you know. I did a demo with my girlfriend and when I was trying this demo with my girlfriend, my girlfriend told me like: oh, can you please load the scary one and you can see that scary is not one of the keyword but as a human, you may have guessed that the scary one is is the hunted out.

D

So, let's see if it managed to be as smart as a human, um it's load the scary one.

D

And boom he managed to understand that the scary one is the until until one. So it means that uh he's still aware of the context. So this is working really well thanks to many different texts, so I'm going to show that now in the code, um so first I'm using the teams AI library, and for that um which means that the team's Area library is doing part of the job that Dan's just shown you before I just need to provide my Azure open, aik or open AI key.

D

So you see that in my code, I'm covering both cases, if you're providing and as your open AI keys, I'm going to create the teams, AI object required to to do the job or otherwise I will use your open, AI key I'm using gpt5 GPT 3.5 turbo in both cases to do most of the job and then I've got what we name um action. So you see that I've got action there.

D

There is three type of action that we've seen in this demo, but to execute for the beginning of it, meaning like create 10 cubes, manage to map this intent. This prompt to this part of the code and then what I was doing. I was just doing some basic checks and I was emitting the code generated over web socket. So what's the way it's working there, I've got the bot running on the right. I've got a tab app so which is a web app.

D

That's going to listen to some websocket input and the bot is going to send some websockets information to the web page to share the code to execute. So this is how it works. So this is what here the bot is doing is going to take the code generating by the AI from your prompt push that to the web page and then I've got in the web page somewhere to execute live the code for available model.

D

This is a bit more elaborated in a way I'm going to understand which, which is the right keyword to search for then I'm going to do a fetch request to the PowerPoint API and then I'm going to do a little bit of parsing like boring, parsing as usual, and at the end, what I'm going to do is to change that with. Can you please display the list of model and we're going to see how it works? Finally, we have load this model, which is pretty simple because load.

D

This model is just going to take the name of the model that is currently being displayed in the list um and then do a do. A simple load query like it's simple by video on GS code, to load the the object in the current the 3D scenes. So the way it works you need to configure the system prompt, so don't just show that shows that uh before the system, prompt is a way to configure the AI.

D

You know in under a certain scope, so in my case, I've configured with my system prompt the eye to pretend it's an expert in Babylon GS. Fortunately, for us there is a lot of GitHub repo using Babylon GS, so what GPT has been doing is calling a lot of GitHub repo with some Babylon GS code and is now good enough to to generate a Babylon GS card based on uh llm.

D

So it's going to behave like your Java script and that we don't yet expert and I'm going to say that you have mainly free action to do like you can load a new model. You can generate some code or you find find available 3D models. Then this is the way to tell him like you will have free action that you have to call in in my code, AS we've just seen in the typescript code.

D

So this is what the teams AI library is going to to do, for you is going to take the Json output by the AI map that to those free action and call your code and then the more you're going to help the AI with context the better it's going to be so 12 the AI to be even more accurate in a way I'm going to provide the current um model available. That I.

D

Just display my adaptive card list I'm going to also send back to the eibc the current list, the user can see in the chat in a way current model loaded. Let's imagine I want to modify something on like as to the year. I have to have loaded the house can make. Can you make it bigger?

D

um You know smaller? Can you move it? You will understand which model I'm talking about and I'm, also standing back, the full code being generated so far to be able to uh to help the AI to understand what it should do and then we're sharing that I'm doing the same and I'm going to remind to the AI, because something it ends some instance to forget about what I would like to do. Please only try to generalize those actions, because sometimes this is a recent update.

D

I did to my code sometime, the eye could hallucinate I, don't know if you heard about this specific word like AI could generate in a way something that is not going in the right direction. So you should really try to. You know force it to think like. You would like it to think for your own needs, so this is a way to reinforce the direction uh like that.

D

This specific Json format is the one from the teams AI Library I'm, using meaning that everything, of course, is going to be Json and and passed by the team's AI library. That then, is going to uh call my code on this various action for this model.

D

um This is the Adaptive card that I'm going to provide to the AI, so the AI can also understand adaptive card so I'm going to to tell to the AI. This is probably the base uh Json for a schema. I would like to use, and you see that I've got like a play solder there with URL and item and then what I'm going to ask to say here. This is this: is the image list which is the list of URL I would like to display. This is also the complete list.

D

Please can you fill the this? Is where I'm telling the AI to do that? Can you feel the placeholder with real data and that is going to generate adaptive card that I'm going to display in in teams, so the last part is I wanted to do something also for uh accessibility.

D

So you can imagine that someone is collaborating with me in this meeting and maybe is a visually impaired or maybe completely blind, and this is an issue of course, when you're doing metaverses like that or 3D words like it's highly visual, so let's imagine I would like to ask to the AI to help me. I've got the command which is like slash, describe, let's see what it's going to do.

D

Puppy still works.

D

Well, I forget to ask the bot to do the the command. You see the common mistake, I'm doing.

D

And now the verse you see going to save and it could also use you know a voice for that. This called creation cube of a circle with a radius of 10. Each cube is given a random color and blah blah. Blah is Cube, 4 scale up moved by two units and a 3D model of aunted house is important and scale free time to his original size. So it's managed to understand, like what's going, uh was displayed and to do that. I've used a slightly different model. This time you see that in config Json.

D

This is something you can also fighting in teams AI, you can use a classical.

D

You know properties of azure, open air, open AI, like temperature, like you, should have looked to the documentation to understand what it does, but you can change also the model, so in my case, I decided to change the model and to use text division in my case- and this is what the prompt did so most of the time what's fun when you're playing with the eye you're spending some time more time, designing your prompts right in your car now, and this is like a simple prompt and manage I managed to build.

D

So if you like to play with it, um there is this is available on my GitHub. So you will have a real me to follow how to set up it and play with it, and you simply have to go on this specific URL, GitHub, slash, davr or us, which is my Microsoft Alias and jardib, and you will have the code and Jarvis stands for just a rather very intelligent. But so, if you know Iron Mine, you knew about Jarvis. Now you know about Jarvis and PC.

D

Is everything I wanted to show you thanks a lot back to you, Visa.

B

Excellent really really cool awesome, awesome, technical Nema and I love the fact that there was a good discussion on the chat also about what would be the real world scenarios on that and there's a lot of a lot of technical scenarios there. That's. This is more a technical demo, but there's a lot of interesting scenarios on this as well.

B

I like by the way David said explaining, for example, I could say manufacturing companies who are meeting with customers or prospective customers to show off the details and products and prototypes a really good example of how things could be done so awesome job and and do the example of the AI Generation stuff as well excellent David. If you don't mind, can you paste in the link on the chat, uh excellent David Warner actually did that? That's all good and then next we'll move to Kishore related on, develop and contribute to power.

B

Automate designer, okay sure should be in a call. Can you guys hear me yep? We can hear you. Fine teams has been working a bit stranger today. So all.

E

Right um and I see that I was not able to share, but now someone has given me control. I didn't know that feature registered in teams, which is awesome. So so let me quickly jump on to my screen.

E

Please let me know when you can see my screen yep.

B

Without the screen, let's go to the presentation mode and we'll move forward there excellent. Take it away. Awesome thank.

E

You vesa thanks David, for um for inviting me to this call. I'm super excited uh to be presenting this.

E

This new program in power alternate that that has new program in the first program of its kind uh and I'm super excited to be presenting to this Vibrant Community and I've I've been uh participating in these calls and and I really love the excitement and enthusiasm uh that the community uh is is rallying around uh in this call specific, uh so today we'll be discussing uh how to contribute to the power automate designer right, so uh We've, uh we've open source, the new designer and we'll talk a little bit about what this new designer is.

E

And what does this do? What what? uh What kind of contribution that you can make to the designer? And again, if you have any questions, you can always ask me: I'm a PM on power. Automate I've dropped down my email as well, so, if you're interested, if you have any questions or clarifications I'm more than happy to assist you uh so the the the the headline is, the new designer will GA soon right.

E

So the new designer that you're, seeing on the right, that is, the power automate designer on the web, the I don't know if you are aware of power automate, but Power automate essentially lets you create automations our workflow automations, as we like to call it uh in a citizen, developer, friendly way or in a low code.

E

No code way right, like think about, think about all the repetitive, boring tasks and manual tasks that you you've had to do like copy files from Excel to OneDrive or copy items from SharePoint to to teams or when something when a when a Excel rolls value changes or when a SharePoint columns value changes. This is urgency. Just send me a team uh teams message right, like this kind of uh repetitive tasks, that you do what, if you could automate it.

E

So that's the purpose of power automate right, like just in a very Layman way, um and the designer helps you create those automations. What we call Flow so you're you're, seeing on the screen here of flow uh or automation on the designer, and this this is the new designer that is gonna, get generally available very soon right.

E

uh This is a new designer we shipped at preview as a preview feature and build which, which was on May and now we're finally ready to publish this or release this as uh worldwide as the new default uh experience. So we're really excited about this new designer we've heard great feedback on this designer we're making significant progress on the designer uh and the the cool thing about this designer. Is it's open source right? So so you are able you, as the community can contribute to this designer, and what does that mean?

E

That means that you can write code that shows up in our designer, in both logic, apps and power, automate, so logic, apps is another Microsoft product. They also so we're both on the same designer. So what what we essentially did is our designer is based off of their designer core designer repo, so any contribution that you make to the core designer repo it shows up in both of the Microsoft products, with with more than 10 million monthly active users. How cool is that right?

E

So so that is in totally new paradigm that that we are following uh right now, where again, the the product team, the engineering team, is super.

E

um Is this what it's worked out, trying to trying to build features and trying to address customer pain points and how cool it would it be if the community itself, instead of waiting for the product team for for months or or weeks or months or years, even uh to ship a particular feature on ship, a particular bug fix uh what, if the community instead could code and contribute to the designer itself right?

E

So so that's the whole idea here um and again this this designer uh the code for it, the ux for the designer is in typescript uh again. uh If, if you you are looking to contribute, you should be pretty familiar with GitHub and in git uh the Version Control mechanisms, uh the the language is typescript again um and using typescript, git and GitHub. You can either contribute to issues which are bugs essentially or you can write a whole feature. So let me let me uh let me show something um following this link again.

E

This link should have everything that you need as in how to get started with the repo.

E

What are the prerequisite and everything, and it also talks about- and it also talks about the designer Community contribution and then all these different things that we talked about, as in um we partnered with with David's team in creating these cool badges, uh uh which you can obviously Flex in your LinkedIn in your resume in your MVP application, uh that okay, look at this like we've gone to, I've, contributed personally to power automate, and this my code is actually getting used by millions and millions of monthly active users in Microsoft right.

E

So so that's the whole idea here, as in you, either contribute to a bug or a feature, uh and we have separate baz programs for both of these. uh So if you just, for example, if you uh do one bug fix, we accept your code and it shows up, uh and it shows up on our portal. You'll received a power automate issue, contributor, present and I'll also show you the how the badges will look super cool uh yeah in a while as well.

E

uh If more than five bug fixes, you will be uh issue specialist if greater than eight uh you'll be an expert. Essentially, uh what you could also do is uh features or feature wise right. uh You could contribute to both. You could contribute to bugs, or you could contribute to features for feature if, if you contribute just on one feature, you'll be a designer specialist if more than two you'll be you'll, be called an expert for the power automate designer feature um and I'll show you I think bugs are pretty self-explanatory.

E

Literally write like little bit of uh nitty-gritty details on the ux, but for feature site. I'll show you something that should probably be uh be of interest. uh First, I'll go up to the designer, so this is the new designer that I'm talking about your code has a potential to show up on here on the portal that that gets used by uh millions and millions of monthly activities right.

E

So one thing that that I noticed here in the new designer is uh I cannot copy paste in action to other side of my flow or other parts of my flow right uh previously in the in the classic designer or in the Legacy designer I used to be able to right click on an action, I could add or copy to clipboard and wherever I wanted to paste it I was able to paste it, but that feature seems like it does not exist today or since the product team has other high Pride items that they're getting to, and this has never been on top of the backlog right.

E

So if this feature seems interesting to you, it seems intriguing to you. uh One thing that I also like to show you is that same feature is a request.

E

The same feature is a request that that we put put on the website right. So you see that you you can like the clipboard copy paste. Functionality is something that we're accepting contributions for, and we've provided designs on, how it would look. So essentially, you would be coding a feature. That's right at the core of the flow authoring process.

E

uh Some some some fundamental uh feature like a clipboard feature like it just gives you a sense of uh the impact of your contribution, as in um the the copy paste is pretty integral to to flow authoring, and you could code something like that, and there are. There are tons of other features uh that are listed down here. uh As in you could come out, you could undo redo your actions on the designer. You could disable any action in a flow, and then things like that right.

E

uh The details for which everything is on this website I will also paste the link uh to this uh deck on the website, as early on the chat uh feel free to take a look. If there are any questions, please reach out to me and before before.

E

E

Okay and before I drop off I also want to show you the how the badges look uh right. So this is a sample baz and again thanks so much to David for creating these bags. These look awesome. uh This is again we as I said there are two buckets uh the features and the issues, so there are two separate badges.

E

So it's an opportunity for you to contribute to both as well uh again, it's being awarded by Microsoft 365 and Power Platform Community, uh you get a star, uh that's for the starter uh contribution and again, as you move up the The Specialist and the in the expert uh kind of um Rank and the Stars start getting added to this pattern. So if you, if you contribute a lot, if you, for example, if you contribute two or three features you might have, uh you will have three stars on your badges.

E

uh Also, the year is 2023 because we issued this badges in 2023. uh yeah and again. These are the greatly badges that you must be aware of uh previously uh that that will be awarded to you. uh If uh we we get a contribution, that's signed off from our team.

E

um Having said that, I I want to thank uh I, want to thank David and Bessa for giving me the opportunity to present this program that this sort of program we've never done before. uh So we're really excited to see where it goes, uh and just that idea of the community uh rallying around and contributing and helping other community is it just. It sounds really appealing to us and that's why we made the new designer open source on GitHub, and we will start starting this program to just evangelize that that idea.

E

Having said that, I will uh pass the Pastor Mike to David investor.

B

Excellent, thank you Kishore on that one, a really really cool setup uh awesome to see more and more open source projects uh done also by engineering and, like Keisha said, was saying. First, one in Power, Platform site uh awesome awesome to see the the direction so see. Even Microsoft does open source close to different organizations and Technology stacks and everything which is really really cool. Now, let's actually, then uh summarize the call and go through on what's Happening next week, so, first of all and next week, next week's agenda for 3rd of October.

B

Oh my God, it is already last quarter of the year uh next week we'll have waldek who's going to talk about the latest on Microsoft 365 developer, approxy, a lot of cool features on there. It's a brilliant tooling for helping you to do development and within a Microsoft, 365 um awesome, awesome stuff, but he will explain all of the goodies on that. One Aisha is going to continue on you. Such an open, AI GPT prompts to generate completion for email and SMS messages.

B

So this is the series which uh danap was covering this week and started already two weeks back, and then we have shupam Gohan talking about getting started with adaptive card based Loop components which is currently in public preview, so really real cool capabilities again uh shown next week within this call.

B

Now, during between the weeks, if you might have questions or you want to engage with the community, one way of engaging is also signing up for our Discord servers, so we do have already more than 500 people within this Discord server and active, more and more active discussions, which is awesome, so we're really trying to make a forum uh where people can easily have a discussion and share their learnings and and help each other within the community.

B

Discord is one of those options which is available for you to take advantage really easy to sign up for as well now related on this course. We would love to get your feedback. uh What are the course? What do you think about this course? uh Are they good? Are they bad all that stuff super super important for our internal uh processes as well?

B

If you have good ideas or suggestions, please do let us know as well um so really really important for us to know and your input for our future Direction within this course, and now, let's uh just recapping when we started uh I said the recording will be available in the master, 365 and Power Platform Community YouTube channel, uh it will be there within 24 hours, typically in 18 hours uh subscribe today, so you'll know when the recording will be available. You can also follow up on Twitter or X.

B

Whatever the services nowadays called uh or in LinkedIn uh is one way of always knowing whenever there's a new material available. The next call is available in October 3rd, like mentioned, and all of the available Community calls. You can download the invites directly from akms4, slash, Community forces course, and that's it for today. Thank you for the presenters. Thank you for the attendees. Thank you for the awesome discussion once again on the chat.

B

uh Let's stay in touch and let's use the other social media channels throughout the week uh without when we're not in the call thanks, everybody stay safe, bye, bye,.