Backdrop CMS Camp Presentations, 15 Jul 2022

Previous Meeting

⏯

youtube image

►

From YouTube: Solr, Lando, and Backdrop - Backdrop LIVE (July 2022)

Description

Justin Keiser shares his experience with setting up the Apache Solr search application with Backdrop CMS. This was a recording from Backdrop LIVE, July 15, 2022. He uses Lando, a local development environment based on docker, to run both Solr and Backdrop locally so that he can develop his site search functionality.

A

All right welcome all this is one of those topics that I was. I was curious whether it would be all right to do um it's one of those quests. One of the subjects where you people ask, can backdrop do this. Well, of course it can because drupal could do it um so setting up solar locally with backdrop and orlando, I'm justin kaiser, I'm officially a drupal web programmer at for the academy of model aeronautics in muncie indiana, I'm kaiser jb all over the internet.

A

I work at the international aero modeling center, which is a thousand acres of area for our members to come, fly their model airplanes. I was outside looking at them today that wasn't for us last year, but that was sitting out there today and I didn't get to hear it fly, but trust me.

A

It sounds like a real jet because it is- and this was apparently the model that won their scale modeling national competition, the b25 model, but apparently they don't get to fly it during their competition, because it's just on display for everyone to look at.

A

Why solar, um since I first started going to dribble camps, I heard the word solar and I had absolutely no idea what it was, but everybody talked about using it.

A

So it's a java based search application that enable that you can enable full text search with that is much faster than the core search module and you can do fun. Things like add, stop words and synonyms to the search configuration so it can.

A

You can eliminate it searching for a and and the and you can set up synonyms for it where someone types one word and the search results bring up another bring up the word that you want people to find so I'm interested because they have a drupal 9 site that runs six solar cores.

A

One of these index is about a million records so when I turn it on, it takes like three days to index.

A

It's quite wonderful, but I only do that locally, because I don't mess with the live site with the member directory and a million records I'm also interested in it, because on that drupal site we have a google custom search application that searches all of our websites and returns results some of the websites it searches. We don't have any more and not all of the websites we actually have are in the custom search, and I want to eventually replace this.

A

I want to replace it with some kind of federated search, because when I was at florida drupal camp in 2019, I saw this really cool presentation on federated search with drupal solar and react, and I liked it a lot. I liked the idea of it, but I didn't have a way, a reason to use it.

A

But I also need this. If I do this, I needed to work with backdrop and wordpress too, and also I'm. I was a librarian before I became a full-time web developer, so I have a master's degree in library and information science, so organizing information and then searching for it is kind of something that I'm into so working with solar search, kind of fits that little need.

A

So in order to make this work, you of course need lando rental backdrop, site locally, newnen's jpi module in the solar search module optionally. You can use the facet api module and there is another search, api module that I discovered in drupal called search api attachments that I kind of ported it.

A

What the search api attachments can do is that if you have a site with a bunch of pdfs, it will actually, instead of just searching like the title of the pdf, it will search full text search the contents of the pdf and return results based on what is inside the pdf.

A

So to begin with, when I was searching for this, I found an old set of instructions for running search api solar with umami on drupal 8..

A

So I followed these instructions and set up this test site with umami, and that took took me a really long time. The first time, because I didn't know what I was doing, but we got it going.

A

And then I kind of put it away for a long time and I decided that I really should make the drupal 9 site work. But there's.

A

Six solar cores, which is quite different from the test installation with umami.

A

So I took a look at those instructions.

A

And I effectively did the same thing for backdrop, so a very simple lando file under services. You just add a service for search and say solar 7. You name your core, that's important, because you have to put in the configuration in the in the ui of the site and as long as my solar configuration is actually in modules, slash search, underscore api, underscore solar, solar, hyphen conf, it works.

A

So I run my lando rebuild what not and the site spins up with a url for the solar.

A

So you install the module, turn on the module and then there is a menu item under configuration search. There will be search api and you need to set up a server and an index.

A

You go in and edit the server name, your server doesn't really matter what you name it here, I'm doing it locally, so I used http.

A

um The solar host is what you called the server this the search service under services. So if I called search like backdrop, my solar host would be backdrop.

A

And then it automatically spins up on port 8983. You can change that in the land file, if you want to, and the part that was slightly confusing was the solar path, because in the drupal 9 module, there's actually two fields for that. There's solar path and then there's the name of the core.

A

So I didn't quite know what that meant. The first time I tried to configure this, but it worked out that I just had to put solar slash backdrop, and then it found that it found the.

A

It found the server.

A

So then I needed to create the search index.

A

I was trying to get the server to load on the site, so I can show this first so where it says the connection the server solar server could be reached. I struggled a few times getting that configuration correctly, so it actually said it could be reached, but once I once I figured out what to put in there solar backdrop, then it was all good now when you're configuring the search index under the data source options and the bundles, you can only configure that here. You can't change it afterwards.

A

So if you select that you only want to index pages, if you want to then index pages plus posts, you're going to have to go back and recreate the search index, so I just I just set it up unrestricted.

A

And then comes the next step, which.

A

You need to select the fields that you want to index.

A

So it looks like this: this is.

A

This is a completed search index, but up at the top here in the there's, there's fields, so you want to select well definitely I want to index my body, my body text, because that's the most important thing.

A

In order I have, I also have my text. I mean terms indexing in order to get that you have to open up this ad related fields and say: oh, I want to add tags and then we'll add the fields up here up at the top, so you can actually select them.

B

C

Do you mind if I ask a question.

B

C

um Can you, instead of indexing the field values? Can you index the rendered content like what you see on the page instead.

A

You can definitely do that in drupal, 9.

A

Seems like you should be able to.

A

With drupal 7 or backdrop, but I don't see it displaying in the same way, because there was a field that actually said rendered.

A

But I actually I didn't like using it because.

A

Where I was using, it was with the pdfs after I installed search api attachments, and it would. It would display the the wall of text, everything that was in the pdf instead of just displaying um an excerpt.

A

If anybody knows about that feel free to pop in.

A

So continuing on the selections up here, the next, the next step is setting up filters, so the instructions that I had said to always use bundle filter, which means that you can separate your search index out after the fact by content type and which vocabulary that you're wanting to index and then node access because you don't want to have.

A

Oh, I need this check, unpublished, notes, that's what I was going to um you: don't want to search to index, uh unpublished, content or have folks be able to access things through search that they couldn't normally see. That's what the node access one is for.

A

And then the important one after under processors is the highlighting, because that what that will do is it will highlight the word that you searched for in the search results.

A

After that runs after you set those things up and you index your content, then you have to make a view to display your search results.

A

So when you set up your view.

A

A

The name of the search index.

A

This is something that was slightly different from drupal 9 2., so under what I want to show, I'm going to show my default node index was because that's what I labeled my solar search index as you can't change that afterwards, because you're creating view you, I always wanted to select search index because I'm creating a search index, but that didn't work.

A

Then we test the search to see if it works.

A

I guess we could look at the view a little bit more.

A

So I'm adding title that I indexed the search excerpt that the um that was created by checking highlighter highlighting box and then I'm creating a full text search box and I decided to limit my results in the view to only my article content type rather than change what was indexed or what was set up on the server.

A

Then I get the search relevance.

A

I sort the I sort the results by relevance, so I have the most relevant results at the top.

A

And this is a this is actually this is a local version of a working site, but there's like 10 years of magazine content in here, so I can search for helicopters and find all of the magazine articles that were put in the site about helicopters.

A

Which is helpful because we couldn't necessarily do that before my brainstorm about this was after I set this up, I thought. Well, I have 10 years of magazine article content in this site, but the articles themselves don't have any taxonomy terms on them.

A

There's there's no tag field, so if I did want to create a link somewhere on the site that went to all the articles about helicopters or all of the article about aerobatics or all the articles about control line- or you know all of the articles about scale, I couldn't do that so the brainstorm came when I could, when I thought well, why don't?

A

I just add views bulk operations to the view with my solar results and then I can search for these items and find the most relevant articles and then use videos of bulk operations to add taxonomy terms to the articles.

A

So I created a second view to be able to do that.

B

So let's see scale.

A

It looks kind of funky because my my table is running into my sidebar.

A

But say I could select just, for example, the top three and I can modify the entity values for those articles and I can say, add the scale tag to all three of those things.

A

This site actually isn't in backdrop, yet the live site isn't drupal 7 and I've been I've.

A

Obviously test migrated it I test upgraded it, but I'm doing a lot of things to it to sort of try and clean up the content and make it make the site more usable in the end, when it actually does move to backdrop, because I have no time pressure to do it, I still have a year to do this, so I'm I'm wanting to make it like, adding these taxonomy terms, to the articles and doing things like adding author fields to the magazine articles and then associating the articles that everybody wrote with with the author on author pages and all sorts of things that just and adding fields for the issue that the magazine issue, the article was in and those things I can't do, those things on the live site.

A

So I'm just playing around a lot and solar became part of it.

B

C

Ask how did you get the uh the tag list in the sidebar like that exposed.

A

That's coming with taxes.

C

Okay, yeah sorry.

A

That's coming with facets.

A

I I discovered that there was actually a bug in core for the taxonomy module where you weren't, that was failing when I was trying to add the taxonomy terms with the views bulk operations. What it was doing was I'd have a list of 50 articles and I wanted to add the same taxonomy term to all 50 articles.

A

Well, instead of creating the taxonomy term once it would create it 50 times in in the in the structure, taxonomy tags, so it was awful. I ended up deleting all of them and starting over, I thought the first comment in the issue: queue about the bug 10 years ago on drupal.org was fascinating. Like I'm, going to put everything now, wow, that's just stupid.

A

But there was kind of a hacky way to fix it in the issue queue. So I I solved the problem, but it's not the right way.

A

Now we're going to talk about the facets. This worked slate. This worked pretty different in backdrop and triple seven for triple nine.

A

So inside, when you install the search api module inside the search api, they search something called search facets. So you turn that one on, but you also have to install a module called facet api.

A

You turn that guy on.

A

And go back to.

A

Setting up the node index and that's where you add the taxonomy terms and oh wonderful, my my search indexes disappeared. It's that happens, oh it's because they changed something we'll see if it re-indexes flawlessly. I kind of doubt it.

A

But to add the taxonomy term field, my tags field. You might think that you just need to click this field tags right here, but that won't work. You've got to scroll down to the bottom and open up the ad related fields and.

A

Click on tags and then it adds all of these other available fields and the important one is tags name: field, tag's name, save the changes. Do a re-index.

A

And then, once you turn on the search facets and the facet api, there's going to be a there's going to be a selection up here for in the menu for facets, and I you select that oh, I want to add a facet for the taxonomy term names and save the configuration.

A

Let's go back and see if my search index re-indexes.

A

Sometimes this craps out, but I've got another site that we can look at with. But it's not the real say.

C

So conceptually there um before, you can add a facet on something you need to make sure that you're indexing it first. Yes,.

A

You need to index the field that you want to create a facet for.

C

A

And every time you select or change a field.

A

That you want indexed, you have to re-index, which, if you have more than 2000 records, could take a while.

A

It if it was like the the search index on the drupal 9 site that had a million records in it. I wouldn't want to change my fields every day.

C

Have you noticed any difference in indexing speed uh on the drupal 9 site versus the backdrop site? I mean it sounds like they're different scales, so it might be hard.

A

Different scales- but this is, this is probably faster backdrop- is probably faster.

A

And I haven't, I haven't done a drupal site other than a big site that isn't just test content that I've created with develop.

A

So I really don't have something to directly compare it to. I might when I upgrade a d7 site to a d9 site, and I want to put solar on it.

C

Oh, while we're waiting, I also had another question: um what's the um the reason for like six solar cores? Is that purely like a scaling thing or.

A

I don't know it's. It was that I didn't I like the agency that built it. I haven't ever asked that question.

A

They all do different things. So there's one for there's one for indexing, the member directory and there's one for indexing all of the clubs and then there's one for indexing. The events and there's another one for site, search that doesn't really get used huh and there's another one for indexing hobby shops that we don't really use anymore. So it's probably down to like four.

C

Well, it sounds kind of like they set up a separate solar instance instead of separate indexes. Almost I like it, isn't that that's like I.

A

Know what I know now, I would probably try to do it with separate indexes and you would use the one so the one server and do it with separate indexes. The indexing worked yay.

A

So inside inside the facets there is a configured display.

A

So you can change the the way it displays from links to links with checkboxes.

A

You can alter how many are going to display you can change the sort of what is displaying like the count is the number of articles that is that has that taxonomy term in the parentheses.

A

And I honestly haven't messed with any of this. I've just kept it at the default in the past. So what this does is it creates a block for you.

A

So then in drupal and you go add the block on the blocks structure blocks. But we don't do that because we have layouts.

A

And it's like a smart block. It automatically only shows up where it's supposed to.

A

I ended up using the layout wildcard module to create a layout just for the solar search, so my my default layout only has one sidebar, but I wanted the solar search to have two sidebars, because I wanted the fastest to show up on the left and then the right hand side to be like it is everywhere else.

A

So you place the facet api block that you created when you enabled facets where you want it to appear, and then it's going to appear on the search result page with the available taxonomy terms.

A

It might be easier to look at the the built out, devel content, so.

A

If I search for ipsum text this one's on the right, but this this filter by tags is not going to show up on any other page, but a search result page and you don't have to add any visibility.

A

Restrictions in the layout.

A

I will say that there's one thing I haven't been able to figure out with those with the with the facets.

A

They get truncated.

A

And I don't want them to be truncated.

C

Instead of helicopter, it was like helicopt right, yeah.

A

I kept looking in the the menu for the configure display to say: don't con, don't don't truncate it, but it didn't seem like it was truncating it with the devel generated content, but it clearly is on the real site.

A

So I've got it. I want to figure that out because I don't want it to say helicopter.

A

This is this; this is far from production anyway, so, and the other thing I'd like to figure out is what exactly this relevance number means like what is 30.2040401.

A

I want it to be a percentage of like this. This is not this. This 95 matches your search.

C

Just as a as a guess- and I have no idea if this is accurate, but um it might have something to do with the uh stemmer plug-in that it's removing the er from helicopter. You know because that it's like going to the base of the word, and so it's like, so it's not actually truncating the word. It's stemming it. I don't know. I guess.

A

Yes, yes, okay, wait hold on.

A

A

Let's see if that's a selection in here, because there was a.

D

A

But that is it: let's turn this on wait for that to turn on, because in this uh in this drop down, where you're searching full text, there is actually a in the d9 version. There's like a full text stemmed selection, but that's not here.

C

A

Was familiar to me.

C

This uh tags name that you've got here. The type is full text. Maybe that should be string instead, so that it's the whole thing.

A

Let's see if it changes.

C

Yeah, of course,.

A

You're gonna have to re-index.

C

A

I'm gonna have to rename re-index it again.

C

And sorry, if this is totally derailing.

A

It's not, I was almost through the slides anyway, um while we re-index it yeah, there's we we talked about this.

A

The only thing I have really left to talk about is the search api attachments. So let's uh go kick off that.

A

A

But this is, this is all still real new to me, because I don't know how any of this stuff works. I've been clicking around a lot and trying a lot of things when I was first faced with the drupal site that had solar, I looked at the views that were displaying the solar and they all said this content data source under the fields that we're displaying, and I had no idea what that meant, and I was very confused until I got it running locally and then it started to make sense to me.

A

Well, that's gone.

A

I want to talk about the search api attachments because I think it's really cool.

A

I wish I could get the module to work all the way which maybe I'll revisit it and get it to work all the way, but I ran it through coder upgrade turn the module on.

A

Everything ground to a halt when I turned on the drupal site.

A

So I'm going to turn it back off.

A

ah Let's reindex.

A

Okay search api attachments, so I ran this recorder upgrade I put it in this, put it in my modules folder. I turned it on and I had the settings menu, which is awesome, didn't error when I turned it on so I had found more instructions online about how to in how to search pdfs in drupal with apache tikka, no idea what apache tikka was, but it pointed me toward search api attachments.

A

It didn't explain how to use the built-in solar extraction method, which is considerably easier than the teka method, because I don't have to worry about installing apache tikka in my lando, as well as my solar.

A

So the built-in solar is how I tried to set up the backdrop version.

A

And there was really nothing to it. I kept all the default settings. I saved the configuration and then I reindexed my contact because I had some pdfs in there and the indexing failed got an error message.

A

There was, it was something about. It was checking for size of the file that it was indexing and didn't like backdrop, didn't like how triple did it so I commented that line out temporarily in the code ran the index again and it worked.

A

And they're really, this is this- is cool because.

A

In this in this test note here, I've just got test and it's something called test: pdf and there's one one word in it: there's blurrg!

A

So if this was just searching the title of note and the contents of the node.

A

There's no way.

A

That would come up as a search result.

A

And it does I've got a full. I've got a full um pdf of a magazine in here, so I can search for corsair, which is oral, rotate fighter plane, and it brings up the april 2020 issue of model aviation. Now, what that doesn't do, which would be the cooler user experience? Is it doesn't go to that part of the pdf? That actually has that word in it.

A

But it did actually bring that up, which it wouldn't have done without that experimental module.

C

It can't do the little excerpt, snippet thing.

A

I actually had gotten it to do the excerpt. I don't know what happened to it um or maybe I only had gotten that to work in drupal 9., don't remember now, but I have seen it work.

C

Yeah, that's great, so you didn't end up needing to use tikka or whatever it was just. This is just solar.

A

This is just solar, you don't have to use the tikka. Tikka might be better, but the module does not work. The backdrop. Version of the module currently does not work with tikka.

A

Because it won't find it and it's- and I don't know about the other selections in the module like this pdf to text- I I haven't- tried to use ever in drupal or backdrop, so I don't know if it works or not.

A

I I have gotten the t go to work in drupal, it's kind of a complicated process to get it in the in the lando file it to run it up locally. They found instructions on this too, and the window instructions definitely did not work, and I spent like an afternoon screwing with it trying to find what to actually do so. It goes under app server as extras in the lando file, and this is going to download a bunch of stuff and it it it installs tikka.

A

In the backdrop, exactly like it does in drupal, but there's there's something messed up in the experimental module that it doesn't actually find. It.

C

Yeah, it's probably hard to tell if it's like. Is it a lando thing you know or is it a modular thing like? Is it right? Is it in the server or is it not yeah? It's always a little hard to tell.

A

Let's see if it truncates, no, it doesn't trunks it truncate it. Thank you. You fixed it.

C

C

Well, maybe we should just change that label, then maybe that's what the the drupal version did. It's just clarified.

C

You know string versus full text like it would be helpful to know that it's going to stem the full text version yay, that's great.

C

I I'm also just really surprised. uh I first of all I didn't even know search api was ported for backdrop. So that's great, and on top of that, I'm impressed uh surprised that uh um search api attachments which hadn't been ported. You ran through coder upgrade and that's it like. It worked after that.

A

There weren't there were slight tweaks after that, but it was actually not bad yeah. That.

C

Was great like there.

A

Were like a couple things that I had to change after I ran it through code or upgrade and started working yeah excellent.

A

That's uh that coder upgrade that it's the only kind of ports that I do so you know if it doesn't, it doesn't mostly work after I do that. I'm like I, don't know what to do now.

A

Any other questions anybody gonna go off and install solar on their backdrop site in production. Now.

E

I'm definitely going to test it in staging. You know it's the the search, that's in core. I keep running up against some issues with it with users and of course you know for those of us that are on our side of the equation. It's easy! Well, why don't you do this, but you know when you're dealing with anonymous users, you can't control what they do and and I've been trying to really find a way to have like these fuzzy google-like searches that they can just do and come up with at least some results.

E

They give them something that they would expect back and- and this definitely looks like a move forward, so I mean I appreciate all the time you put into this and uh you know definitely I'm like all right. I see a way forward for you know what I need to do. You know that's going to solve some problems and obviously, like you said you know not something you want to necessarily throw into a production site, but it doesn't seem like it's that far off. To be quite honest,.

A

Oh I'm, I would use the solar search and the facets in a live site. No problem, I probably wouldn't put my attachments module for it.

C

Yeah, just generally like I, I speaking to what brian just said, I'd love it. If um you know the core search did work better yeah. I feel, like it's been highly neglected for decades, almost to like the core search hasn't changed in backdrop or drupal in a very long time, and I like it would be nice if it just worked better like the con, the concept of it like how it creates a search index and the index uh you know, makes separate tables and then it that the indexing all works.

C

Fine, but like just the actual interface for showing results and everything like that is all not not good, and I don't like how it segments users versus nodes like it, separates them by entity type like lots of silly things in the way that it's done, but there's always going to be a place for search api, even if core search gets better because things like this pdf search like core would never do that. um So this is it's pretty incredible to see um it's all. Working together.

C

Yeah, I guess what I'm saying is that it would be nice if you didn't have to go to solar so quickly you know like, but I think that that's that's been like the default uh assumption is that I don't even bother with core search just go right to uh right to solar.

A

Well, I never searched the actual contents of the node to me and only search like the titles.

C

Oh well, that would be a big problem yeah it should. It should do. Oh well, maybe if you're talking about like the you know the admin content search, that's only searching the titles for sure, um but, like the actual like search page, you also can, I think, maybe also what might have confused you uh at 1.2 when you were in the views setup. I think.

B

C

Index actually is core search index, and so you can- and this is a difference uh when drupal 8 ported views, they removed the search index from views which is still in backdrop and still usable. So you can actually set up a view to use core search that works way better than the normal search page.

C

That uses a search index table uh combined with views to like make something kind of like search api's listings, but it still doesn't have facets, which is you know, highly useful, so.

A

I I like the facets. The way it's smart. It only shows up where it's supposed to show up automatically.

C

Yeah yeah, I like how you um you know how you set up a layout for your search page. That seems like that's a really smart move too.

A

But it does require the layout wildcard to add it to more than one url.

C

To have the same yeah, yeah, yeah, totally.

C

Yeah, I think I see a lot of sites, I'm not not actually sure which way to go on um setting up a lot of pages that it looks like possibly what you did is you set up. The view was a page display, and then you added the layout on top of it, um as opposed to the alternative to that which is you create a layout, and then you create a block, and then you place the block within the layout page and, like I'm, not sure which way you know is actually better.

A

It would probably be better the block way in backdrop, but the instructions that I had that I followed out. There always said page, because that's the way you did it, drupal yeah.

C

So I didn't try it with block yeah, because you only have one global set of placements in drupal. So of course you wouldn't want to block because then yeah what would provide the the page like there would be no route. You know there'd be no path other than the view uh in the world of drupal, but in backdrop yeah. You can make that a layout.

C

Well justin, this is this is really great and honestly uh I like, I can just see the dozens or hundreds of hours that it probably took just kind of like bumping into dead ends and then like trying to figure out a way around it. So I think this is. This will be an enormous time saver for people, following in your footsteps, to get the same thing accomplished um yeah. This is really great, and and thank you for sharing.

A

C

It doesn't it, you know, this is one of those things. That's like you, don't need it until you do and then and then it's gonna be really helpful to have this resource.

A

I'm I'm interested in trying it with elasticsearch too, but I don't. I also don't know anything about that. So.

C

Yeah I I'd like uh the thing that bothers me most about solar is um the black box that it's, that is the configuration of solar itself. You know it's all xml files and uh some kind of schema thing, and I don't understand how any of that works.

C

But it sounds like it looks like for what from what you did. Is that, like there's already a schema file that was written for drupal 7 and you just said yeah, I used that and that seemed to work well.

A

It's inside the module.

C

Yeah yeah yeah.

A

Let's, let's uh go back to.

C

Yeah, every every time I've wanted to see solar do something like advanced like the answer is like oh well, it's in your schema file. I'm, like I don't know, yeah.

A

What's in this.

C

A

You can you can alter this to make it do whatever you want, and I mentioned stop words and synonyms. Like you just add a you. Just add words in this text file. Oh.

C

That seems simple. Here's.

A

Here's the one for model aircraft.

A

It's got a lot of stuff in it.

A

No search api, solar.

C

It seems kind of like it. Oh, I see, there's only seven dot x in there. It seems like probably uh yeah like this stuff. Six seven eight seems kind of like that. Stuff should probably be consolidated or renamed to a backdrop. Namespace.

A

Where'd it go. Maybe it's in here.

B

The schema.xml is that not it under 7.x.

A

Oh yeah, that's it, but I was looking for the stopwords file.

A

Maybe I maybe I deleted it in my moving things around in the local site. I don't know there used to be one there I'll fix it. Someday.

A

In the in the drupalize me there were, there were um explanations: instructions on how to alter this file the schema.

A

But yes, it was slightly complicated to wrap your head around at the beginning, but I think I could probably get it because it seems like librarian stuff.

C

Oh, you mean just like the vocabulary and the words that they use you're like oh yeah. I know what these words mean.

A

It seems like, like yeah, this is kind of how the library catalog sort of worked behind everything. So I don't know perhaps yeah that'll be stage two like understanding that.

C

Okay, uh well, it looks like we're out of time. uh Thank you thanks again, justin and big applause from uh from.

B

C

All right well great, well we'll close out the session and uh yeah we'll go back to the main room thanks so much again,.

A

Awesome. Thank you.