Cloud Native Computing Foundation KubeCon + CloudNativeCon China 2019 (Shanghai), 5 Jul 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Kubernetes Multicluster SIG - Shashidhara T D, Huawei & Xun Pan, IBM

Description

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Kubernetes Multicluster SIG - Shashidhara T D, Huawei & Xun Pan, IBM

SIG-Multicluster is focused on solving common challenges related to the management of many Kubernetes clusters, across many cloud providers (so-called hybrid cloud) and applications deployed across these many, hybrid clusters. We are responsible for designing, discussing, implementing and maintaining API’s, tools and documentation related to multi-cluster administration and application management. This includes not only active automated approaches such as Cluster Federation but also those that employ batch workflow-style continuous deployment systems like Spinnaker and others. Standalone building blocks for these and other similar systems (for example a cluster registry), and proposed changes to Kubernetes core where appropriate are in scope. In the introduction, we will give you an overview of the projects we're currently actively working on, how best to get involved, and what our future plans look like. Then we'll dive deeper! We recently released the second version of our biggest project, Federation v2 as Beta, and have gathered user feedback on how and why several different companies are using it to solve their particular multi-cluster use cases. In this deep-dive session, we'll take you through what's in this beta release, and the results of our findings about its real-world usage.

https://sched.co/O4WW

A

I hello to the session this session is about cig multi cluster introduction we type and updates from the community members.

A

I am Sachi from Warwick I've been a active contributor to Sigma T, so particularly in Federation, so I am join the earth at IBM China. So he has. You know, automating a lot recently so problem you wake in Chinese, so you may understand better how about the deep dive you will cover that e.

A

So coming to you agenda, this is what we have for today, like mission already spoken about in various occasions, but still we then about, will talk about the active projects under the sig, but this is not exhaustive list of the projects which are inside the scope, but we have been actively involved in these two. So this is what we will talk about and we'll talk about what we have been doing in the recent past, and then we give our deep down in thing when it is cluster filtration.

A

A

A

So, coming to Sigma T.

A

A

Around or related to the mighty cluster have e, so this does not only include the active, automated approaches like tinnitus classification, but the scope also includes many other multi cluster systems like the flow based continuous deployment system like so. What we intend to do within the sig is basically to build basically to provide a basic building block to address this multi cluster scenarios.

A

So the problem domain is multifaceted and we don't expect everything to be solved within like one project or so so there are many existing projects like the STM multi cluster or recently the Submariner, which tries to address a multi question. Networking so they're very much excited to hear about that. There's a session later today about from Mariner, so I appreciate, like everybody could again back to so so this you won't been outlined in the our committee of the page. Also so.

A

Vacubot efforts, so these have been actively pursued within the sig right now, so the people ask are really the biggest kind of dispersed team. There are multiple committees right now within the sale or domain like if you just.

A

To name a few, there are many others, so within the sig. What we basically do is to build basic building blocks. We don't try to provide complete solution for everything so I'm to any kind of facility. Probably we just build the basic building blocks which common to all projects, and then that can be reused by the systems which are implementing their multi clubs or scenarios.

A

Okay, so coming to cluster identity, this has been identified quite a long time, but it was kind of installed, but recently they have been feeling like talking. This leads, so this needs to be in place so many other projects or systems they have went ahead and implemented their own cluster identity. It becomes a harder when you want to make or use some components from other project. So basically the motivation behind our identity is right. Now the kubernetes cluster doesn't offer like unique identity either that cluster can be identified with.

A

So this is particularly important when you are dealing with multiple clusters like when you have multiple clusters. You might need to know like where, which is open in which log like logs or events related to that coming from each cluster. So it has been fairly important thing. So there has been a lot of discussion going on in the sick, so it is almost finalized. Probably we can see API within kubernetes both to identify a cluster, so that will be soon added and the next term active projects which we are pretty much. We are all involved.

A

L is good fact, so this has quite a long history and recently, like a month or two, we renamed the addition.

A

But we initially started off being compatible with the caters it yeah, but that posed quite a lot of overhead, so we moved on. It is kind of for evolution right now so right now the super pad is not a catch-all kind of a system. We try to provide them with the basic building walls and try to be modular enough so that it can be reused with other project like maybe you can go, add them useful side along that is so magical, so maybe Submariner whatever project is required.

A

So we try to be lightweight and try to offer only the like, you can choose which features you would like it.

A

So, okay, so who fight, there's, basically short form for kubernetes cluster progression? So we are Vincent is the name between five and the cool name. Also, you know from 252 to practical- and this is our vanity URL, which is currently alder.

A

So let's talk about the group Red. What is the trick for right now, so it is basically record. You name like that user if he wants to pollinate occupation across multiple clusters,.

A

A

Seamlessly can coordinate the concentration, the contribution here. What we mean is basically about the caters resources, so you want to you have under sub clusters, and then you want to manage them together from the single. A pair is a paste of creds, so this would be an ideal fit eating. So also this approach, also what we implemented is activity cancellation like that actually keeps doing the reconsideration of the desired state of the haps or the resources so easy.

A

So what currently we have is the basic building block, so you can go ahead and uh build high level features around it, like Geographic redundancy or on the cluster scheduler. It could be like so so we are. You have to see all those built upon the basic building block so currently, where we are at about the stability of the project and such so recently we are targeting, but.

A

But already a lot of users are already started using it and we have received a lot of feedback, so our article is getting expanded. So that's today only we believe the acidly.

A

So probably you could expect swim like this in the Vita, probably probably beyond that I will be supporting the backward compatibility.

A

So, okay, let us talk about what we have been doing so far in the recent past.

A

To do that, okay, I will take you through a demo.

A

So we'll be deploying a crew-cut control plane then enabling with those vivid types of data types, and then we generate an application. A simple application.

A

Override button now particular cluster and then how you can control the placement of the resources to specific clusters.

A

Okay, it's jump onto demo.

A

A

Okay, so I have a control plane already deployed here. I have two clusters here, plus the 1 and cluster. Two and I have a control plane deployed. Basically, the control plane is the core ApS of Federation, plus the controllers, which are running so.

A

This network is little stove, sorry, father.

A

Okay, so I. Okay, we start with creating a namespace called demo ii.

A

And create an config map or deployment and our service.

A

This is a very simple and Jeanette sab.

A

Okay, so the deployment uses the file mounted by the config map and offers the web server. So this is the simple app now what we have done is we have built a tooling around this like to take a care test, resource and wrap it around and convert it to a Federation type federated type. So what I am trying to demo here is like the namespace, the contents of the name space will be federated and I've converted to a Federation. If federated types e.

A

Okay, so they have been converted, the ceoddi has been installed and then they have been converted and then installed into Federation API server. So that's why.

A

Okay, so this is the the federated deployment type of which we have defined so it it has a directives called template, which is basically wraps around your kubernetes resource, for example this here, whatever federated deployment is, there is a deployment within the template, and then we have placement over so replacement directives. So by default we place it to all the clusters within the Federation and there is another directive called override by default.

A

It is not enabled so we'll show that later and then you can see that there is also a status part about the propagation status so to where which clusters the resources be federated. Okay, so right now it is ready to plus 1 and 2 dB, so I have a. This is a more support kind of a service, so I am just wearing true curl.

A

There's a lack sorry for that, so, okay, I'm cutting the closer one. So okay returned response.

A

So the same thing I do with a cluster to.

A

The purpose unstable actually sorry for that.

A

Okay, so the same thing is replicated across clusters: okay, the next stuff I'll show. How do we override some things.

A

To do that, we are going to patch the federated concert map.

A

Just a one particular property or a field, we are going to override, like the content of that so but go back on Shanghai so, and this will do only for cluster two.

A

A

It is, it takes a little time to do the reconcile group. So just let me.

A

Give it a little time the cluster should be able to pick it up and restart their part.

A

Yeah, it's more.

A

Okay, next up, let's show about the placement.

A

To do this, we are going to apply a label to the cupid cluster.

A

So right now you can see now in our federated deployment, so it has been deploying to cluster 1 and cluster 2 by default. So we have two classes in the Federation.

A

Okay, so we are going to label our cluster bond, that region equal to China, East.

A

Then we are going to update the placement saying deploy only to clusters, which has this label region equal to China, East.

A

Yeah now you can see it is not deployed to cluster. It only deploys to the matching cluster okay. So let's want to the slides.

A

A

Okay, this is the architecture of coup fed. So basically we have a type confirmation, any KS resource we kind of up, convert into federated type. So and then basically, it has template placement and overrides directives within that type. We need this is a new AP type, that is the CRE which we create during the we have provided tooling, for that like to convert any caters to source to the Federated version of it, and then there are a little flutter configuration like what all classes are there in your Federation.

A

You need to do a join for that. Go, join your predation and then using this information like there is a controller which can propagate these resources to those clusters. This is an active reconciliation model and, above this, like you, can build up your custom controllers to work. We have sample working prototypes like the cross cursor service discovery which we have built and scheduling so which are built above this basic building gloss.

A

These are not yet moved to beta, but depending on the features we will move those later so then there will be a propagation status which will be collected, and you don't have to visit each and every cluster to look at like what is the status of that resource.

A

So tooling, as I told like, we have built a tooling to enable any given type without changing the core, so you have a Cadis resource. We can change it to Federation reserves and the deployed to the Federation control plane, and this particular credit is for a single command like you can use it in a command line to convert from it's like it, just a templating kind of a tool.

A

So what we have done in the recent past is like. Initially, we started off with rotation v2. We initially separated these separate CR DS for data type placement and override due to reasons like the different actors can control them, but we realized that it is a harder problem to solve, like for both developer and a user to group, all this for a single resource.

A

So later we kind of this is the change which we did before this beta release like we have put all of the directives or we call it sub tenants to within a within a single, unified presentation type. So now we also have a status which gives the propagation status of it.

A

So, and also as part of moving to beta what we did is to conform to the KS, a paste back. We have a few federated tradition, type series which are required for the functioning of the features which we have develop.

A

Okay, so going to.

A

Sorry for this PPT actually I couldn't see the Google Network, okay, so coming to future work.

A

So we plan to improve the usability and documentation around it so that the learning curve is smooth. So we want to make it as easy as possible from deploying girls. I have a single cluster. Moving towards I have a deploying a half to multiple clusters and we plan to go. I unplug in to auto, convert the manifests while deploying so that the default behavior it could be deployed on to our multiple clusters, and then we also plan to do some higher user level facing API. But this is harder problem.

A

So there is some other work within the community like 1/2 C Rd, which are tries to do these things, and we also plan to implement a full reconciliation kind of a model when it is similar to G, Dobbs or multiple clusters. Okay, so I invite sheep and to give a little more debug into the internal features.

B

Wait I got another review, I will enjoy on the Acura fighted Harris yeah cushionless only see dat about those.

B

On national coverage, natural omission, hip control doctrine, yellow ho chun-yin, our covens junior hawk had a controller without me. Holloman so now should I know. She's known factor in her she'll follow suit. On there you go Vova.

B

Well me: oh, you go home to Utah job killer fighter Ohio, you go controller, Thursday, cubicle, Tony, Harnell, shot relationship, even harsher tone. Covenant super Jana, so hello, Michelle, around cuber vitae, the controller TRADOC niceic. Last her she joined our little federation leave Vienna yoho-o, murabba nyesha, listen, Natsu yeah, you Federation Leto quality you're haunting some of your her bow meeting agenda, covenants that so yeah and her Federation robot put almond Suwanee the putana. You got the Leticia, you chip see directly initially I'm over rano.

B

You wanna, look upon me when I can't have me hungry again: well, Charlie, she's young. She all wrong! You got put on the cluster home break a couple controller, confided controller and yet I know MA Chile and the according to her co-worker Bertrand chief on 1 July. The number one occasion tell me about you got member who didn't truly underclass again: G Dominica cubic federal control, Eli!

B

Well, Michelle social magician, Junction, CO, Cooper, fight the controller treetop, your knees, yellow cluster will kill you well toshiaki on kill provider to contract it up what Samuel Shannon dionysia cluster Abell, Georgian water, so yeah, I'm, okay, Katya, so general Hawk ever come to join witch-hunting a service account exactly go member to Casa rubia under the service conduit. You and Alicia are back the choice. Yong Yong, hak Tsai member class super cute wrong. Yet so young Grisha ah ho ho chun-yan.

B

You got killed by the cast her woman's editing, the CRT now exactly to say: RDR Omaha member cluster APR, the pointer funny to you more allegiance, a benevolent you Omaha, Omaha and I, say the token for you, your Latrice Angus is here: module, hey I'm. The QB fund contradict each other Walter negativo, chief alma mater sharing the member cost. How are you why you shot me on that ego? Say secure communication? Saban? Don't you so what you got ancient ocean? How are you sure my own ego, shelter said it I teach intro.

B

She taught us how to you as a token, so I love the movie Mahesh or Yolo man. You you become to join Georgina, you go kloster de purify, the class 30 good resource. Aha, The Mikado! Is you now, without what man you become controller? Whiny, the phone intranet ha ha woman, the key go eat ye o like they give a contour cream Fat Controller. You go class her to tonify duration, HR oku other.

B

Hot, on borrow, ganga class started in Idaho town cute. Only a federation cluster mission, L told you to pop more Eagle Asian, let's say yeah some fat out is your castor. Don't you the more music hakuna usual? Well, male badness, yes, yeah! So in part put on the classroom, don't you well Michelle? Can you show us, you know you can kill your neighbor like a ownership, be shown your about deployment from pop. Without this year, quality got members. Usually don't you don't you kill you, you further enable Department general.

B

You mean you, don't how about you talk, then you go by the redheaded deployment. Usaid here show me either /, don't really mean I'll show you got ego pertinent, so you got kubernetes, that's a patent. We aren't you from without is a potent lot? Don't you tae-yeon Oh show me on the TV from the opportunity. Don't you know, John McEachran, jango, fett, irritated type, configured yeah terribly Angela, mhm engineer ago, federated department, home and Charles I'm about to journey transgender deployment.

B

Tasha contra, so you go Paige.

B

How you look at this a serial hope, your home, not a problem new. You gradually led the city to hold on. Oh you, Kaiba Mesa, Pandita governance class, our continuity, you got Department ohayo.

B

ah Sorry, Yomi OTL, oh, we sure, can tell me fatter, Italy, garment you'll, learn it at your home UK back de primer, Thunder, pathology, janila, the Ohio. You got suryanarayana Oh sugar namespace. Your name is miss sugar. Don't ship had no Grenada soda Syria, no modular unit test on his face. What robot huh film about what the class 3 class the art about you, children shown you yo trøndelag of federated department, the honey, sadly virtue xalapa.

B

What the Department of our class sorry class, the art class or salaburu Ron Wyatt has the name is specific garden too much. Even who told oh no. My name is Reza. Federated name is based at taller. You gotta assure limitation, children, soul, partition upon you ho ho.

B

Now how come you cannot use sugar butter in custard. In fact, how you fatty right here, namespace that ego centric Trish on such guanine shall cut away Columbia? What are you on cloture motion cluster creep immigration about how to create twenty ago? Well, you chick gg-go cluster that you fire a namespace contingent in space change in South, Asia, gog, gog, gog, Dido, no matter Yahoo long horrorshow had a Undertaker member class. The family jump, which have very little names, mean sociality plan.

B

Once I saw a resource static, compaction from totally illegal communist resource or touch deputies. You know about paddle man, Federation, qualitative decision, raunchy, Doha, nama, shoyu, military Jewish, community I, wanna results till the militia ball mention column, you don't need a change from not covariance cluster. You please entirely the whole moon, Cooper control, fader, it Chidori xie na ma. Tell me Louie, bunny, John, Jellicoe, saturated deployment, chattering, you sure deprived of unity prior to Shanghai I, don't have a bucket at Department one Chancellor, Dog soda, remember class. Are you guys Nakano philosopher?

B

What may you got results of what they aren't? So it's a cooper fighter, she's wrong. You only help. I got name of a she's. Acting a name is very. We are talking so that you are burning Tony de favela soul of such as you know. She yeah so in yoga yoga Federation in space with content to create Erica movie.

B

B

B

Sugiyama cause actual digital Familia organization. On the controller I got soy, see attrition your granny ginger. Is you talked to Angela? Yes, they are. They are you Tommy, you Cuba father, you never home and John de la Vega federated type configure before my deployment. Ela you go by the really. The type configure Norman's have enabled a controller about how a condom cannot hold. What are you in a single controller.

B

I, do a triangle single comfortable, really big, eccentric, uncle Richie, incognito soda side, the retail deployment.

B

Look, what have I said, oh ha ha way: bad sci-fi, the redheaded deployment he be already here check out deployment from father-son when the cancer from Chu Yahoo attend contender contact. You bought young woman's, a fatty reality promised by a teeny disorder bones you so on the member clairebr tuxedo shirt too young.

B

Jolly sure to call Jenny, Mollen negotiation on location, sound, true law, department service, gender is here results to an Omaha condo, the CID, the resource nominee, rural woman. She uh she talked or damaged, who truly put on the only thought, stuff, I wanna win man. It only sounds cheesy. As I said, imma Samba sanguinary got results the Teen Choice on track, but that's all you got unstructured. It's actually a road banner rotate this structure in order to convey whatever Childre you know and her.

B

She go home on the tomio aoki intact, ADT Hahira, cheese Romero you go amudha, truly noisy cribbage, my usual poor, actually Department service here is wholly for the return to this area. Okay, but I, don't we don't know she's, actually plugging the Santa.

B

Ronique Allahu Allah Luke war, woman put it out to go to some place in the narrow, omit some young, a new church. Anyone nutrition super sure, updated to Rome critical Federation federated the primal, conga sugar children, defiant, Allah, WA member cluster together, so the Department on China will eventually go check. Some oomba template I override, so it has have new high Samukai. Beyond hua hua Chong sent you palm the human resource tab for Dasha, one classroom, Xu Jia, you Jia, you want us to the MBR G translation.

B

Tell me how quiet I wrote I tell you itís a like how you go to couldn't simple tutorial Jory's here. The way you wanted. Aha, ok, sister idea.