Kubernetes Storage SIG, 6 Jul 2017

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Kubernetes SIG Storage 20170706

Description

Kubernetes Storage Special-Interest-Group (SIG) Meeting - 06 July 2017

Meeting Notes/Agenda: https://docs.google.com/document/d/1-8KEG8AjAgKznS9NFm3qWqkGyCHmvU6HVl0sk5hwoAE/edit#heading=h.e2xu3sl4x6bo

Find out more about the Storage SIG here: https://github.com/kubernetes/community/tree/master/sig-storage

Moderator: Saad Ali (Google)

Chat Log:

[none]

A

All right welcome. Everyone today is July 6 2017. This is the bi-weekly meeting of the storage special interest group for kubernetes. As a reminder, this meeting is public and recorded today on the agenda, we're going to go over b2b. One point: eight, two, three planning the second round of this. We did the first round last time.

A

The things that we want to finish up here is make sure we have reviewers and assignees assigned to every task, go over the priorities and make sure that, if there's any feature bug that needs to be open, that someone is assigned and going to open that, then we're going to go through PRS that need attention, looks like we've got a few that folks have already posted in here.

A

If you have any PR that needs attention on the wider community based into the agenda duck and we're going to go over some design reviews, we've got two here with not very much information we can go over. Those then brad has an item to go over the external storage repo and then Tushar added an item about updating on how to improve collaboration between multiple groups. This is an issue that I think our community is starting to run into now that we've matured and I think we've got more than 50 people showing up to this meeting.

A

So we need to make sure that we remain transparent, open and collaborative so, first off. Let's kick it off with the planning spreadsheet we went through and added items. If you think there is an item for 1.8 that we should be working on. That's not on this spreadsheet. Please add it to the agenda. We could review those at the end. In the meantime, let's just go through these line by line CSI volume, plugin I think priority here is valid one. It's a multi release a multi quarter, a project for this quarter, we're targeting and design.

A

It does need a future repo issue and the future repo issues already assigned I'm going to be driving it I, don't believe there is a sign e for a reviewer. Anybody want to jump on this and to be clear.

A

We want at least one person as owner and reviewer, but obviously these are going to be multiple people working on it. So the purpose of this is to at least have one person assigned to each and then you can grow from there. We just want to make sure that there's someone that we can talk to usually I.

B

Can I can review it cold.

A

C

If you want a second reviewer, you can flip them down. So.

A

C

A

A

All right, that's the isolation resource-management. This is something that Jing is brought to alpha in 1.7. She is going to continue to drive it and what they we already have a reviewer. If anybody else wants to work on that, please reach out to Jing local persistent storage support. This is something Michelle brought to alpha and 1.7 we're going to continue to drive it Michelle drive it.

A

We already have a reviewer and if you want to work on that reach out to Michelle testing, Erin's been doing a wonderful job here and she's volunteered to pick this up again. I, don't think we really need a reviewer, their.

A

Block volumes support Erin who's driving this conversation as well and looks like we have a couple other owners assigned as well and reviewers look good. This is a p1 for our group for this quarter. I think that makes sense targeting alpha for this milestone seems reasonable. The conversations in the electrical so far enable containerization of mount dependencies. I think the priority is correct here. One Yan has a proposal out, there's already a feature open for it. Humble has agreed to review it. I should beneath that refactor.

A

So let's fix this. Whenever the Jace is going to be meeting this and lemon is going to be reviewing and it is buck level work volume plug-in metric the month is going to lead this and need a reviewer for this. Anybody want to sign up.

A

Sorry did someone say something: did I miss that.

B

Thanks tied up with there's no takers cool.

A

A

A

Let's see do we need a future issue for this I think we did to the last volumetric, so we probably should have one come on. Are you okay opening a future issue to track this work? Yeah.

D

I'll okhla head to the hall open a design here: okay,.

A

Thank you and Aaron. If you're on the line, I missed that, could you open a feature to track block volume, support in the future repo.

A

Next up is NFS. Wedging issues is bug level work come on bond is in this. We need a reviewer for the design. It is actually a design change. It's not a simple bug fix so who wants to volunteer to review this.

B

Woman Chen down okay.

A

Unexploded snapshots I think we left out what the target is going to be for this release. Do we want to call it alpha or a.

B

A

Okay and Tomas is the right person here and home both going to be reviewing it I'm, not sure. If Jing is on the line, Jing I, don't know how much see here, she's, not all sync up with her offline and see how much she wants to be involved with this going forward for the next quarter.

A

Priority for snapshot resizing we set to that seems okay resizing going to alpha a month with leading so Mont you're going to have a very heavy quarter. This quarter he has a booking.

D

Yet the resizing is like a lot of quarters, already written I'm, going to probably call for another follow-up meeting next week to discuss some remaining issues like the especially on the file system. Besides the controller resizes phase, because yeah okay.

A

Okay and if you feel like you're overloaded, feel free to ask for help and there's a lot of people on this Colin sure we can find volunteers to pick up some other some of the stuff yeah.

D

Okay show cool.

A

Dynamic update of PVC TV I think we're going to leave this on track for now, because it is kind of a implementation detail depending on how the resize design lands, whether it's a requirement or not the reason we're tracking it is that it is a fundamental change to user experience.

A

So we want to make sure that if we go down that path, we do so very consciously and then there's documentation to track that this change is happening.

A

Exposing storage class parameters to end-users yan had a proposal here he's going to continue to drive this I once signed up for reviewer. For this, this is a design change.

A

I can hear you, it's not um I feel like you might be overloaded this quarter, but thank you.

D

A

Actually, you know what let me also sign up for this. One I think it's related to CSI and I should be taking a look at it anyway.

A

Improving the trimmer tack, I haven't had a chance to talk to Jing Xin just got back from vacation, so I need to sync up whether there's any work that still needs to be done here. So for now, we're going to leave this empty and also the scent afterwards fix, broken vol reconstruction Chakri is working on this for 1.8 priority seems reasonable any reviewers for this work. This is making changes to the quality and manager code into blip.

A

Alright I will roll volunteer for that. One.

A

Host path, volume type: this is extending the host app volume API to have a volume type. There is a owner for this already somebody who's working on it these, because that was.

A

A

I think Tim was being reviewed, X I'm, going to leave him as the reviewer for now. Unless someone else wants to jump in.

A

Okay, release mount options to GA, so go ahead. Put a months working on and humble is agree to review. I think we're good they're going to GA. There's teacher issue already open their bonding API refactor for I scuzzy. This is something women proposed any reviewers for this.

B

You can put Y down there, alright.

A

Cool thanks, bread.

A

Is this something that's going to be, it's going to be bug level work right, not necessary sure we wanna track. Oh.

B

Yeah, it's that's a bug level. Okay,.

A

So it should not need a.

A

Featured repo bug and should be another cool, the roof volume plug-in Steve is working on. This is warming. The right person to review the spread all.

B

Right yeah that works okay,.

A

And everything else looks good here. Next up we've got a p3 which is PVC capacity, usage stats, it's nice to have user friendly feature, I, don't think we anybody signed up to own it. Yet does anybody want to sign up? If not it's a p3? We can leave it on a sign for now and you can take it up later in the quarter needed I.

D

Was just saying that these stats are by the relative level as matrix not directly as a cube, cuttle command but they're, also because already level of matrix for the most part. So it's not like we.

A

Got it so we'll be relatively low word to surfaces, yeah well, okay,.

A

Cool anyone want to take this on might be a good starter project.

A

Okay, we'll leave it on the side for now and then we can pick it up later on cleaners.

E

Rabbit I can take this on. This is babba from Gangnam. I can take it on sorry.

A

Who is that this.

E

Is that hub, B, comrade captain I can take it on got.

A

It cool thank you, yeah.

E

It's a starter project, so I'll look at it and we'll see how it goes. Cool.

A

A

All right and anybody want to sign up as a reviewer for this project.

F

Complete without Adam here.

A

Glad awesome thanks man, sure.

A

So we're going to need a feature open in the future repo for this I'm, going to leave that red for now and I'll leave it up to you to create that as well data replication Brad, this is assigned to you. We've made it a rate priority, so I don't think it's worth assigning a reviewer at this point. We don't really expect much traction on this disk order. But if something happens, you can keep us updated and update this accordingly. Okay support attach detach for rwo volumes such as I scuzzy, fiber channel in our BD.

A

So this is a going in and refactoring some of the existing code to support or attach detach- and we put one priority question mark- is everybody okay on this one woman I'm looking at you.

B

One is on pto, so yes,.

F

B

Know women: this is a pretty big issue. Yeah yeah.

A

I'm going to assign myself as reviewer for this because I don't quite understand what attach detach for ice code, you might look like just a budget will attach to watch this. Okay, I think the confusion that I have is my understanding was that requires code to be executed on the node we so I, guess that's where the disconnect is, but we can follow up offline.

A

A cloud storage allow configuration of reclaim policy in storage class.

A

I think this was added recently by Matt Wong Matt. Do you want to give a quick summary of this.

G

Yeah, it's just so that people can create TVs. Let's retain policy instead of delete, yeah I've.

H

G

The work, but we just need to agree because it's an API change on story, analysis, so yeah and.

A

Would we want to reroute want this to go in as alpha first rate, I.

G

Would say beta just because, like the actual code, isn't that complicated but are.

A

You going to be a new field or a starting with an annotation. It's.

G

A new field, well I thought the new convention is that everything has a field, and then we just date it somehow so.

A

Can you add a fueled and keep it data? Is that possible? I must've missed that I? Don't.

B

Know that's okay,.

A

B

This particular thing, I, would say, the risk is growing up and it's you know, falls in with the convention of the other storage plugins and okay. It's really not that risky right. Okay,.

A

That's mine, let's call it beta and let's just make sure that any changes the API are not permanent until we go to GA, but it sounds like it's very reasonable and priority on this. We want to call it too sure. Okay should be these worthy. It does need a feature, repo issue and that I'll leave that up to you open and who wants to be a reviewer on this I can do that. So this is Jeff all right, cool thanks, Jeff, all right cool.

A

So these are all the items that we're tracking for q3 for the 1.8 release. Does anybody have anything else they think should be added to this list.

A

You it doesn't look like it, so we're going to do for every meeting we're going to go over this spreadsheet and attract the status.

A

It looks like we have a lot on our plate for those of you who are working on multiple items to use the priority because aim somewhat to focus on. If you have to pick between two things, pick the higher priority item, let the lower priority things drop, it's needed and feel free to ask for help.

A

We've got a lot of people in this community and I know a lot of people want to jump in and try to help so don't feel like you're in this alone, and that's it so I think we can close up the first item on the agenda.

A

Second item is PRS to discuss that need attention. First, up is the new tonics volume plug-in as anybody from new tonics here want to talk about it. Yeah.

F

This is a support or promote annex. This is a question of bullet plugging like other new plugins, that is there and it balagia dynamic volume positioning as well as tacit support for aesthetic.

A

Okay, so but I'm going to go ahead and add this to the list of items to track for 1.8 and okay sign-u as the as the owner for this, and so you we're going to make sure that this gets in for 1.8. You just need to make sure that you follow the process and create documentation and all that kind of thing. So.

A

And Brad: is it okay to assign one in to review this as well, since he seems to be our plugin guy? Be our code, nice yeah, that's like nice! Thank you.

A

We're going to keep this as at p2. Single release will go to a yes.

B

For, like a you know, maybe that during the storage segment, as a one-off of demo of this I'm not familiar with neutronics myself, nor nor doing a really no way to test it. So.

A

I think they did a demo publicly recently they've got something working in-house, so both might be able to tell you more yeah.

F

Yeah I can give a demo I, don't know where, but I could give it. Maybe whether I didn't get part of this meeting or separately so.

B

We all have womman reach out to you and then we can I set something up for the community. It sure yeah.

F

A

Suppose you're going to need to open a feature bug to track this. This is in the kubernetes flash features repository you just go in there create an issue and there's a template for the work that needs to be tracked when you've got that issue opened up just link to it here, and this red coloring will go away.

F

Okay, yeah hundred cool.

A

So we're tracking this officially and and will sync up on this every meeting next up is the rope volume plug-in I, just kind of fell off. My radar I think last. This was contentious because of the way that the plugin was written. um Hello can.

I

You guys hear me: yes,.

A

I

This is steep yeah, so we did get a little feedback from the community. Thank you for that, and and we do have a planner option, so we are probably not going to do. They use this. The new CRD way to to do the volume attached amount. We had a good conversation, we'll lick it from the API team and I think we are yeah. We're going to be doing two other mechanics in like perfect Maps I'll update this PR. With these changes and and I'll let a bombing against you see the reviewer I know.

I

Let him know when it's ready for review. Okay,.

A

And they want to give context to the rest of the group about what the point of contention was right.

I

So we wanted to do the Rivoli plugging in a to open in a slightly different way. We wanted to make it more of a controller basis. Everything kubernetes, more controllers, great, where you do you set a desired state and there's something else, something there that watches it and then you know and make that a state happen, and we wanted to have CPR in this case CRD to define the state. So basically the holy plugin move very same will be just the main purpose of it would be just to create a CRD.

I

Whenever name is a volume attached and there will be a route controller that would watch for that, and then you know and then do the actual mounting.

I

There was some contention about things, because the Rupali forgave lists in core and because see are these the custom resource definition, our api expression point. We are not really part of possible and when you have something in core which is the volley plugin calling something that is extension, it's been considered as the layer violation. If so that that's that's pretty much like the dilemma right now. So, okay.

A

And so, between the two options: here: are you guys going with the the blocking api call now or no.

I

We are, we are, we are where we're exploring doing a config Maps. We don't want to do a blocky API, because we want to take advantage of all the things that community has in terms of discovery, city, security and authentication. So if we have a blocking API, we need to specify up with the user. We have to specify the endpoint user secrets and all that stuff, and we don't want to kind of avoid that. So that's what we wanted to do. We try to do the CR disk. First.

F

I

We do something: if use a complete mapping set, then we don't have to worry about. The user has whatever in an end point exactly what I've got going so possible, so that will be managed by kubernetes up well, if the end of the ankle is his actually to make the user experience better, I guess: okay,.

A

And the idea would be that root can still remain declarative and watch the config map instead of C or no right.

G

A

Yeah so uh you're going to hate me for this I think we pushed back on previous volume plugins that try to write data into a config map scale like scale IO was one I. Think Vlad was the author of that yeah.

F

A

But we could take that discussion. Offline, I, think it's better than during a CRD, uh but we can take that offline. Okay,.

I

Okay, we can take it offline and feel free to. You know, put your comment on the PID cell that way, but yeah okay mastered.

A

Normal plays cool all right. Thank you for driving this and we'll get in win it all right, cool. The next up is PR four six, eight two one.

A

Plug into a CI testing skipped into this Jeff: did you add this.

J

A

J

I think that was on our last call song and we.

A

J

To it sure I've been getting so the statuses we're very briefly, is I've, been getting good support from Michelle I think she might be um off work a little bit this week or all this week you.

F

Know I'm totally: ok,.

J

So it's stalled some but I've been addressing her comments as well as other reviewers, and um it's just it's just sitting there waiting for final approval. Ok,.

A

Cool if it's non critical, then she'll be back on Monday and she should be able to finish this off yeah.

J

It is the dressing to issues what I think one or both of them are from Michael related to you know, higher volume IO test on the plugins got it.

A

That's something that we've been asking for a while, so they're.

J

Like it's their old issues yet so alright, thanks for working on this, yes sure.

A

Alright, so for design reviews, we have poll seven one three related to.

A

Pr issue number four, seven one one: seven.

A

Does anybody Honus or have any background yeah.

H

Yeah kami, yes, Jem hi everyone. This is Leone and I work from oh hi Jackie. So about this proposal, my colleague Howard has given a simple introduction on the last meeting and today I will give our folks more on the use case and some basic imputation facade. Can you table open the file? The pol? Okay, not.

A

Sure, actually, you know what let me stop sharing and then you can share your screen now way. You can drive.

H

Me know: I can can't hear me open the belt because my not.

A

Sure and no problem.

H

G

Thank you movie.

H

H

Okay, so about this proposal, so about the motivation, so, as we all know, kinetic energy pod anywhere, including because person than they are metals, but right now, as for story result, if you have to choose specific story back and according to the environment community to be deployed here are some example and about the use case. When use case, is we found less some story system the legs Inga, the guy Oh can provide volume resource for permit hood directly, and so in this case, how can you that use these resources?

H

If the kinetic cluster is deployed on this pair metal and the another use case is that we got some testing from users that we should be rich canary stories ever since they were using some story system with on support and then always have a oxygen which is platform in part. I think it would be a hard work for the to develop every store ever because, as we know, the operational attaching volume to host is cloud a complicated, so I'm wondering. Can we share the compact implementation and the providers simple interface for their technology development?

H

So our motivation is to break the limitation, different story systems and the deployed environment and to provide any story taken to the goddess of government.

H

So as for the goal, we plan to create a standalone project in communities and it can act as a leverage providing born with discovery and local management and for any entry volume plugins which want to provide a resource for our manhood.

H

We can't just call this leverage, finish, volume, discovery and the amount of the device class to container, and we also won't want this project to serve for flex volume and the stairs as again and even other any other storage system routine go the here next are some proposed design so because there are a lot of story protocols and some of them are implemented in different ways according to different system types and operating system types. So so it will be very complicated if we directly added this device drivers into volume plugin.

H

So we want to create a library to communicate with kernel and expose or unifying, is to volume packing, and here- and next are some. If you have objects in first week, we we will design some constants, which, which includes some platform tabs and operating system types and and the next are some device. Travel types and and the connector is a interface that indicate what also the world can do.

H

With this lever and the in this in this interface, you can see we we will design four methods in the first stage and the connector process is used to tell story tech and how to initialize national volume and as forth next information it can use you can use to connect a volume and in this drug we have travelling pipe and under map called connection data, which is which differs from gravel volume volume travel volume type, for example, a scrappy driver. You can use SS, escapa connection data here, and here is the summary of the.

H

If you object, if you want to know more information, you can just search the the project called a speak as link here and which is an imposition within Python. This.

B

Crash couple questions yeah, yeah, hi, so I'm pretty stupid, I, don't quite understand this. All right is, it seems, kind of like a another volume plug-in that obstructs a lot of the current volume plugins, but I'm not sure what good so.

H

Well, because ye OpenStack and they have a project called Westrick to do some host, decide one discovery and, for example, if you want to attach a block device to the pair metal you have to. You have to do a lot of things and such as such as dog, in the car target. Long and and then and the connect connects the volume could using the initiator and and.

B

So on, okay! So if I, okay, let me see if I get this right, so a West brick is an adapter layer that supports multiple different volume, types and you're wanting to make a volume plug-in that supports OS bricks, which would in turn add multiple wine types of their whispered.

H

I I think this product is much like a library and you. If you want to provide storage for pair metals, you can just call the methods in the connector interface as Xcode, and you you can. You can just use the library tool to achieve the tax function, but.

C

Would this be something comparable to see all well? This is a way to put a library of out of tree for driver.

F

C

Kubernetes, would that be a fair assessment?

C

Sir? Can you please say it again? Well, it sounds like what what's being proposed is a volume plug-in portal or interface from kubernetes to this external entity. This host volume discovery it potentially has more than one storage together attach step at the exterior. So the way this likes me is being something similar to CS. I know.

H

For visesa is much like: if you want to use, told story, resort is but has create, delete and the N show and other methods you can use the SS, but for this product you can use. If, for attaching the volume to the host.

C

Okay, so it would look like host local storage after this was involved, because when you say.

H

You need cause the local storage, yes, yeah, I I think if this is something that that, but what in this project you can you can contain many many different candle storage protocols such as a Scottie ad, Vee and and the FA and the many other story photo I. Think.

D

I think what this is trying to do is like an adapter, for example, if you're trying to use time to mount OpenStack Center on a bare metal cluster, then you have to consider flow providers cloud providers to be able to use OpenStack standard volumes either way it won't work. So, but if we use this adapter, then we don't need to configure like a cloud provider for the subscriber cluster and we can go through this adapter in states like like that.

D

The host one discovery and you can still use in their volumes from kubernetes or, for example,.

G

D

Assume the use cases we share if you want to use like cinder or when you're running on Amazon ETDs there's no way. Someone can do that like use cinder when running on a TDM, AWS cluster right, I think those are the use cases that this this.

D

This solution is trying to.

H

C

Also again, that presentation, I mowed, a URL that isn't in the meeting notes. Could you either put it there or put it in the chat.

H

Yeah, if you'll have any question you can just just comment on base on this for requests. So I think.

A

The you are those linked in here already at the Virgin's are.

J

F

A

My mic I think I'm having a difficulty understanding where this fits into kubernetes as well home on explanation kind of makes sense, but I'm not sure whether this is the right approach or not I'd like to understand more about it.

A

H

A

So I think the way that I try to simplify everything in kubernetes storage side, because I'm, not a very smart guy and for me, volume plugins uh in kubernetes, are basically a mechanism for consuming different types of storage systems and so far, what we've done with a volume plugins is that for each type of storage system you get one volume plug-in. It makes it a very nice, simple and easy user experience.

A

For our end users, what we try to shy away from is any sort of adapter volume plug-in where you have a volume plug-in that then plugs in a bunch of other sub storage systems, and the reason for that is simply because it's tends to lead to a worse user experience and and for that reason we side away from that so far, I'm trying to fit this into my head and see where it fits.

A

It sounds like it's not just about consumption of storage, but also making local storage available yeah, and we do have a local storage project that is currently underway, which is designed to make global storage, expose local storage to uh to kubernetes end-users and I. Wonder if, rather than this being a completely separate project, that kind of competes with that, maybe we could roll some of the ideas of this into that.

H

In genomics, I, yeah I think I think about this proposal. You, you know you can, you know I, think I think it can work with local storage, codec, okay and yeah.

A

What is uh what was your end goal with this presentation? Is it to add a new volume plugin, or is it what? What is your intended end goal I.

H

I think I think if, if not it's not like a single cinder, plugin or or other volume plug-in, if it's just just like a library, and if you, if you want to use it, you can just import this URL. If you don't need it, you you qu, you can not move your data at all. Okay,.

A

So it sounds like the this is more informative than anything else, and that there's potential for our local storage project to take the pieces of this to potentially be more powerful than it is today. Is that correct, yeah.

H

I think so: okay.

A

So then, maybe we'll point Michelle at this and see if she can- or maybe you can reach out to Michelle uh her alias is Anna, hey you. ah She is right here somewhere MSA, you 42 and, and you can take conversation offline, okay,.

H

That'll be great. Thank you. Okay,.

A

Thank you me on okay, all.

A

Right we've got about 12 minutes left. We've got one more design to discuss.

A

Block volume support Erin.

A

Looks like Aaron's not on the line. Does anybody else want to give a summary of this.

A

So I've been attending I'll go ahead and do it since I've been attending some of these meetings for the past few weeks. So far, we've kind of closed on what we want the API to look like.

A

We can go over that quickly.

A

Actually, I think we should wait for Aaron to return and let her do. This I think there's still a couple open issues and we should probably resolve those before we present it to the wider group. So nobody has any objections, we'll just punt this to next time.

A

All right we're moving it last item on the agenda is to char on the line he isn't, but so I actually added this on his behalf last time, and it was based on a comment that he mentioned, he was trying to collaborate on the snapshot design and it was moving very very quickly and when you comment on something the design doc would be out of date and he was acting. What a better way to collaborate with me and I, hear that and I don't want it to be brushed under the table and ignored.

A

I think this community is growing very quickly. There is a lot of people that attend very regularly, but I think there's only a handful of people who contribute regularly and I don't want everyone to feel like they are not part of this community. They should be. Whoever wants to contribute should be able to contribute.

A

It's really hard to do and with that I just open it up to all of you for any ideas, comments and what we can do better. What we're doing well anything.

A

Somebody talking because you can barely hear you.

A

K

A

A

K

A

K

L

Going into this world I've been listening in the last few weeks, I'm a chemical Forester, and we have a kind of an occupied great version of AFS. If you promote the Andrew file system and we're starting to architect how to connect you into kubernetes, and so really basic question is and is that what Walters the open source open s world war a closed source? You know, so we're not. You know to throw that out there. What do you recommend is the best way to hold our sin.

L

I mean I've been listening to this and just getting a handle on it and there's volleyball games which involve doing something in tree and then there's third party resources. Can somebody give a primer on this or maybe be willing to chat with a boy.

A

Yeah that that's a good question and have very good resources for for new contributors has not been and understand lay of the land. In this quicker case, I am sure community is probably willing to discuss with you offline and does.

B

Anybody want to go out.

A

B

Yeah I'll take it and guys. You know. I I got to feel like you're things, I.

A

Think you got to cut off read. Can you repeat that.

B

Sorry, my internet connection been choppy I. So if you know anybody has questions, comments are or just trying to get started in the community, and they don't feel comfortable emailing like the broader list with questions I know myself and you know others are ahead- are always want to share for people or to spend time with them to you know, help bring them up to speed. They just want to reach out directly and try to ask direct questions or to get the lay of the land we're more than help at a 24 the right direction.

B

So Kerry, if you want to be mean I, think you in contact with someone. That's real close to the volume plugins I can get you rolling hanging that'd be great.

L

How, by the way, do you know David, Howell and the stork immigrant have no. That is not familiar. Okay, he's doing some interesting kernel stuff on a container objects in the kernel. You might be interested in curious to reach out to him. Yeah yeah. That sounds interesting.

L

He's also right he's also building their paths. um Whatever they will tell of life. I appreciate a brad I have I got email address, I'll, send you a link, I sent you a note, and maybe we can chat briefly. Okay sounds good thanks.

L

A

Right guys, I think that's pretty much it does anybody have any comments on this before we close up this meeting.

D

That was the upstream the other side. Never the document to that documents actually like the all wall and plugins and data interface, is what they look like not on to find the link I'll, probably post it, making it considered by some someone in the community. That's pretty good starting point to learn the basics of like how does how the whole public wall of Dragon ecosystem works and.

A

I'll be great, and then we can also go in and update the sig storage community page and as the presentation like that, I think I did that at some point, but may have gotten wiped out recently I'll go and take a look at that cool, I post very much. For your time. Those of your America has a soup of July and have a good week we'll reconvene in two weeks.

A

B

C

You bye, bye, bye thanks.