Cloud Native Computing Foundation TiKV Community, 22 Apr 2020

Previous Meeting

Next Meeting

⏯

youtube image

►

From YouTube: CNCF TiKV Community Meeting 2020-04-22

Description

CNCF TiKV Community Meeting 2020-04-22

A

A

A

And in twinkling, the icon of projects to be able to be hosted in sandbox that you did, but conventional and yes, I believe they have all had, except this one, and- and this is another oversight, but I know where nobody else is wondering old. They won't see it first area like what just like.

A

B

Okay, and when can we study now sure doing so, the only to wait? Sammy, oh.

B

C

C

You're hosting today, right what.

B

What sorry I have it.

C

Yeah I think we can start now: okay, I.

B

I think I'm moderator and we'll how or when he do would you maybe you can share the screen.

B

Jasmine I shared a degree.

C

You have that documents open. You can share the screen. Okay, wait a minute.

B

Okay, can you see my screen now? Yes, okay, thank everyone during the routine and that they see. The second me, while for tech TV, this section meeting for the tech-heavy and now today today and the memory moderator for the HVT and also winching, is a lot of taker and before the meeting we please beware aware that the meeting is recording recorded and will be uploaded to YouTube soon after the meeting.

B

Okay, let's begin and as you can see, this is agenda of this meeting at the first I will do some introduced, introduction and I see now maybe they're.

B

Okay, just ten people participated in the meeting, so we can introduce ourselves.

B

So let's begin, and maybe oh I know to introduce myself at first, my lady, you build hyung, you can call me seated and and also the maintainer of tech, TV and Alexa Kevin whoa whoa.

C

Hey everybody I'm Kevin I'm from pink a band I'm Tommy's manager, the tech-heavy project, okay, neck. Thank you can fool.

B

B

Lot fo can introduce yourself.

B

Okay, I, looking for okay, so what's a PD, Alexa and OD.

D

B

Od I, can you introduce yourself.

E

B

We can hear you.

B

E

I'm going to introduce to you Eliza in this meeting.

B

Okay, that patty said.

F

I'm from pink yeah, you can come.

B

G

Hi I'm Nick, also from Inca work on tacky, a B and I will be introducing the transaction sick of it. Lysis. Okay,.

B

Thank you no way.

H

Focus on the performance of TV.

H

Performance as I said, okay.

I

Okay, I'm sorry from pink help, I just the in transaction and coprocessor, and also I walk and for the developer group. That's all.

B

J

Hello I'm Japan from King Cab I'm, going to introduce the rafter as I see later. Okay,.

B

B

Yankee, can you hear me and a lot of guy working.

D

Hello, my name is one ting I'm from pink hat and I'm, mainly responsible for assisting helping with tyki mikk community operations. It's very nice to have a meeting with all of you. Thank you. Okay,.

B

Same anymore, what attending introduce themselves and somewhere amazing stuff? Maybe we can go up and the second is, you can see a just allotment and you can see that Hecuba villa I impregnation and we are becoming so good and any suggesting I welcome. You can tell maybe you can ask a cabin or a 24 to give me any suggestion. Okay, that's all for the introduction and now the second part is we introduce talk about something about a strategy.

B

Update and I will give these to the Julia and maybe Julie, and can you maybe can you Holy Love and introduce something about sjg, okay,.

I

Can you stop share a screen and let me share as okay thank you and you.

B

Can baby and make Oceana? Maybe you can share the screen? Okay,.

I

Okay, so please.

I

Okay, let me introduce you about alchemy community asaji updates this mouse, and does anyone know about the meaning alpha s?

I

Ig, okay, excited means of special interest group, which means, if you have any interest in any part of food I can be York, enjoys a related s, IG and work discuss with the engineers work for that they work for that this model, and now we have already one two three four: we have already six si G's in tech heavy and the first chuckle process as IG and and ancient si G is very popular now and the other. The left of this is a G's, are still working hard to make themselves popular.

I

So if you have any interested about any part of these welcome to join well welcome to joi them, and now we have imagine the leader of this is IGS here and let them a lesson. This introduce the details, trio, okay, so maybe we can start to introduce start frowns. The coprocessor society so wish wish I was there Oh, since he is not here? Maybe we can just skip to the next one and I'd like to ask him come on later so about an gog is a leader here.

D

I

Could you hear me.

I

Aunt income- a we are you here, Oh shucks, Wow, sorry Oh seems to shall go, both of them are not here. So let's keep em continue about the ecosystem. I think Neil is here so new.

F

Ecosystem sick covers everything about surrounding contents, about thanking me, for example, kind, go kind, Java and classy yeah and, of course, the current rust also it covers the rust prometheus, the client library for the primitives yeah.

H

F

We have a slab channel common because they stick and tech will be double T's. Yeah welcome to join us- and this is mystic- is still in early day, so no cooling works. We will have soon yeah. Thank you. So.

I

Let's continue and about the performance as I think literally always here, so it's your turn.

I

H

All the performers asaji is focus on the improve the performance of tech-heavy.

H

Lift is, we are focus on improved TPCC of Teddy B. We.

H

We will have made a plan with which some feature, so we may try, but we have not footage on the project. Yes, I will I will add a cheat to the project, lead studies.

I

Ok, you can see that details about to the progress of this as IG in this project. I think yes,.

H

The project almost.

H

Some new you planning to the project.

I

Okay, so how can we join you asaji, oh the charge in performance, asaji, yeah, okay,.

I

So let's continue the next srg is the raft as IG and Jay.

J

Jason Simpson is not here and I will give the introduction.

J

Reggie is a special integration group for anything related to rafts eyes and component a rough story. In Turkey we have common charts, slack in int, activate W, work, work, group and tag.

D

J

Gently and funky, you can call attention J and our ongoing works.

J

We have many three ongoing works, the first peak upstream about fixes from each CD raft. The second is the employment concerns as to introduce a small available window when doing configuration, change, and the last is the implement of follow replication. That's all! Okay,.

I

Thank you and let's go to the next and the next is transaction is IG and I. Think Nick can joke about it. Hello.

G

Yes, I will talk about the transaction SOG, so it's very early days for us. We've not really started very much, but I will talk a little bit about what we want to do and what we're doing at the moment we do have channel in slack and group on WeChat. So if anyone's interested in transactions coming and chat was there my personal.

G

Ideas what to do with the group which I haven't yet discussed with the other leaders? So these may well not happen- is to focus on the the special interest part of the special interest group and so rather than starts out trying to get people involved with the transaction code in int.

G

Ikv start by just having a group of people in in transactions and try and build a community that some ideas have a reading group where we can like read and discuss academic papers, do some testing and benchmarking or finding trying to find bugs experimenting with kind of software models and formal models using TLA, plus or stuff like that, and maybe working on for the tiger the clients, because it's because our transaction protocols.

G

Collaborative protocols, it means that there's there's a lot of work in the client, as well as in the tank ad server and so having decent clients is going to be important for building a community around Tycho, be itself and then other stuff like I'm, working on documentation and just general discussion about transactions. Very, so that's so if any of that sounds interesting, come to to slack or WeChat and talk to us, Thanks yeah.

I

Thank You Nick. He gives us a lot of information about the transaction or such and I. Think I'd like to introduce one more thing about Chang as IG for each.

I

Okay, we can, we can see the projects in the tech-heavy repo and for the transaction asaji. There is a lot information in this in its project. You can see first colors at how to join us, and the second color is the to-do lists that need to check. Also, if you have any interest of these issues, you can pick one and assign to yourself and the third color about in progress.

I

These are the things or major project we are doing now and if you are interested in any project of them, you can don't go to see the details in this project and I think this will be helpful. Okay. So, let's.

I

Okay, since we don't have caches me.

B

Know I found that Shao Kahn is here loud. Maybe I can introduce the ending asaji yeah.

I

Yeah yeah and let's go back to the NGS IG shotgun. So sorry.

K

I'm sorry I'm late, I'm sure one.

K

Today, NGS IG folk song, basically anything storage engines in fact away and we do have a slack channel, so people can come to attack, given what group tracks and join us and talk about and yes, engines in tacky way. Okay team come back to the slides, I'm, sorry, okay,.

I

K

We have a biweekly meeting I spell link here, so everybody is welcome to join our meeting. We do have the meeting notes for the past meetings. So, if you are, you have missed, you can check out our meeting notes. um Why is it here? We just had a meeting.

I

K

I

I

K

And now attack leaders, we have three tech leaders are simple young and you and me so one soon so and we are, we have something going on right now. There are two major things listed here: one is improved, prioritize block height for Titan, the other one is a in the face to tackle a which introduced the multiple version, valuing in addition to a rock heavy. So that's pretty much all we are doing right now and we are a.

I

Lot of motion and I think it is most multi. It is the best aside you wish is worried. The most convenient ok was as most convenient way to enjoy it. Okay shark was in Co joining this meeting necklace of cardiologists about you up there introduce yourself.

K

Yes, okay, let me think what start I worked for jus a question and answering websites knowledge sharing, basically website in China I used to work in a search engine part last year and later on, I, I and I switch to in 14, so on managing.

K

Platform and infrastructure.

K

Pretty much all about myself: okay, okay,.

B

Okay, I also look at that k easier. Maybe he can help we can to introduce the cops at hig so.

I

Jerry coyote, you can see you can talking about your compromise as you such equalities. Just page, all your cat just to tell something about each biosea, okay,.

L

Okay, I'm John and I'm copacetic I'm sure of it, and where is pleasure, I think.

I

L

Okay, I can try to introduce the copasetic.

L

First, that the first page is the coprocessor community, coprocessor sikh community page and here are three commuters in composite ik. They are away sure enough. They are the enemy and we use the slag post slack and the wage has to communicate about the tiger. V Cooper, gesture, sick, and now we are doing the two active projects.

L

The first is timeline tracing its due.

D

L

Active contributor ring hi and another is the just an RFC and I'm trying to it's about us. Use the trunk execution in the coprocessor framework and I'm I'm I will finish the RFC England week, okay, and we will try to move back with some more milk building functions from type baby yeah. It's it's very easy for new contributor to a party bit inked.

L

So this is all thank you.

I

Okay, I have seized a most active, most, not topics specific contact with leader to join how this is amazing, I think so anyone have questions about this ascites, since all of the leaders are here.

I

Now, if no I think that's all for the sake of it as a geez, okay,.

B

So then you can maybe stop the sharing and now I were to share okay.

B

Thank You, Julian and.

B

Relaxation is a community sharing and Lord young will give you a forgive us, maybe demo, about Cuban writer yeah. Maybe it's all your time now it's your turn now and maybe you can I was told a share. I know you can do come on it's okay, yeah.

E

B

You can share your screen and shoulder keep you later.

E

Can you see my screen now? Yes, all right.

E

E

E

Thanks all for coming I'm going to use this as an opportunity to tell Otago communities about something really cool that we've been tinkering for a while. Hopefully it will be production ready and coming this tactical point now so I'm going to introduce this thing.

E

I'm going to introduce is the visualization to photogra cluster lemke visualizer, also known as TV's, some of you, some of which some of you might be familiar with tech-heavy, it's good scanning up in Simeon this way, but in some cases you will find hard to work with, especially when performance trapping for no reason well, there must be some reason, but it's much harder to find it than we expected. Maybe you know this tree ability system enough and also not tacky enough, so you are coming with. Are there must be some Hospital in the cluster?

E

Yes, most of the time. Hot spot is the reason of the performance issue, but the problem is, we are still hard to tell whatever hot spot is, in this case and hard to tell where the hospital is.

K

E

Now, with Kiwis they came, they found out in real time and in easy and intuitive way.

E

This is what key visualizer looks like.

E

It's a simple to work in browser, so I'm just going to move on to the demo part of the talk and I'll show you what key visualizer can do and how it helps to find a hot spot. Integra cluster.

E

This is the workflow of TP CH that I ran for about half hours.

E

Let me introduce the details of these components. On the left-hand side, we can see three axes with some labels. They are actually the database name, some table name and the key key ranges, for example, some real news or primary or some indexes, and we can find out later.

E

This is a hidden map showing how the workload distributed in the cluster from the button to the top in the vertical axis. It's the key ranges when a pixels goes from down from the bottom to top. The key ranges goes up and, from the left hand, side to right hand, side it's a time axis.

E

It shows how data are changing, not not data the work log changing in time and the color represents the world log or the traffic in this current and this time, for example, we can see this is a bright line in this fringe, and it goes from this point to this point.

E

What it means is there may be some incremental right or incremental rid of its a right happens in this time, and at some point we can click and zoom in to see. Oh there there's 12, 12 bytes are written, so of million. Bytes per minute are written at this point at this time into testdb the auto long table table the line, and this rule ranges. If we want to copy tid, we can click on it and it's easy pasting.

E

Well, it's some kind of complex, but we will go through some some important pans later at this corner. We I have used this bench. Work load, especially OLTP inserts.

E

It stopped well early about I ran it yesterday, but we we want to see it in detail, so we can zoom in just select and zoom. Then click released. Okay, all right, we're here, quite easy. We can also adjust brightness in case in case of some point are too bright or too dark to see.

E

Okay, I will go through some patterns.

E

um This is a word she built from this image. We can tell that the color is mostly a similar. He meant so that so that means the workload is distributed evenly to every key ranges, as known also known as regions. This is a good pattern. Well, this sure beauty will glow allowed us to extract the maximum power from every tag we notes. This patter is what we expected. This is sequential.

E

It can be sequential, read or sequential write. This often showed up when import. We are in. We import data into tack, away or incremental ID column is used. This is a signal of potential hot spot, because the operation, but because Tacori cluster is hard to split the operations into multiple regions, so take care of it, especially when performance drops and this pattern happens to show up continues.

E

This pattern is similar to the sequential compared to is quencher. It means that some keys of a small range is being updated repeatedly repeatedly. This is also a signal of hot spot.

E

This rebuilding continues well, it means some keys are being updated repeatedly, but in larger ranges in this pattern. This pattern is better than the former, because in this case, tequila is smart enough to distribute they were glow to all nodes of the cluster. I may say this is also a good pattern in cases and there can be more patterns to be discovered in real production by you. Cue Java provides a better insight into TV and it's your turn to figure out the funny thing under the hood.

E

I'm skin our skin and sooner I'll skim through a little bit of the thing inside of huge riser about how its structured and how it works first.

E

Firstly, k-q is raisa basically involved from the old PD statistics, which has been in production long before, but before Kiwis PT's collects the workload data in the time when statistic is requested, while kiwi trouser collects the word lower lip data all the time since startup, so we can see how the workload is changing and see the pattern in time statistic. Data are firstly generated vertically on my keynote. Center knows that the know status to PD by interval.

E

And ple collect statistics reports and then the data is used by key visualizer. One thing important is to know one thing important in your areas: Kira's is centralized, which means in one cluster there. There must be one mostly one key visualizer in instant in the cluster and it's not fair layer, product protection on it.

E

Okay- and this is how Jewish is structured.

E

First key madrasah is embedded in the Pedic binary. Pd is also the server of the dashboard, which is basically the container of some new great tools, for example, huge riser and statements here. Eliza has two components back home written in go lang and a phone and in browser the back end. It's the statistic. Data from PD then generates the him app we've seen. It also does some sort of compressing stuff and does optimization on the cone cases that come up when Regis beats all merges.

E

The data are then sent to the phone and in the browser and.

E

They're, as it is a.

E

Conclusion so I introduced the Kiwis and explained how we can use it to empower our developer workflow by pointing out the hot spot in the most obvious way, which we hope will bring new experience to the user. We are still working heavily on Kiwis, so it may seem to be slightly different to the final version and some more and some more features may be added in the future, for example, Kiwis cookie, which could show how CPU and memory usage change changes in time anyway. I hope you enjoyed thanks for watching.

B

Okay thanks yet and after, and they still wore for today's meeting and make the last question any question about days.

B

Do you have any question.

B

Okay, oh I also found some guy some new guy during this meeting. Maybe we can SN to introduce himself and the first off Tara Tara Tara. Can you introduce yourself.

B

Good here too good here.

B

Okay, other is roscoe PK me. Maybe I have pronounced Liddy. Yet. Oh sorry, subway, okay, Allah Toby, maybe.

M

It'll be hello, everyone and I'm not gonna, be home and working for the city crowd and do you any information.

M

Okay: okay, okay,.

B

Thank You, Debbie and maybe okay vivia. Does anyone have any question if Laura? Maybe this will our to this meeting? Thank you very much and see you next month boom. huh Maybe we can end this meeting, nah yeah sure. Thank you see you next month see.

M

B