Cloud Native Computing Foundation KubeCon + CloudNativeCon China 2019 (Shanghai), 26 Jun 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Keynote: CRDs, No Longer 2nd Class Thing! - Jing Xu, Software Engineer, Google & Xing Yang

Description

Join us for Kubernetes Forums Seoul, Sydney, Bengaluru and Delhi - learn more at kubecon.io

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Keynote: CRDs, No Longer 2nd Class Thing! - Jing Xu, Software Engineer, Google & Xing Yang

Custom Resource Definition (CRD) is a powerful way of extending Kubernetes APIs. In the past, CRD has been mainly used for out-of-tree, third-party things. Today, with the constant improvement of CRD, there is an ongoing effort to refine and enhance Kubernetes as an modular and extensible platform by factoring everything but the bare essentials out of “core” Kubernetes. CRDs and their controllers start to be used for managing even in-tree, first-party Kubernetes resources. In this session, We will take you on a journey of building CRDs as first class citizens in Kubernetes based on our first-hand experience. This made us believe that CRDs can be used for core resources and integrated seamlessly with other core API objects. We will also introduce Kubebuilder, a SDK to build and publish Kubernetes APIs, and explain how Kubebuilder makes it easy to write a custom controller for CRD.

https://sched.co/NrqD

A

Definitely everyone- this is sting hello. Everyone, King and I are very honored to have this opportunity to present our talk in Shanghai cube Kong. My name is Bing and Google engineer. I work for GK Google can take out bananas. Engine storage, lifecycle, team Ching is open, cs3 detect, OBCs is open source project and the link foundation. So we are also proud Burnett. His open source contributors. We need six, are rich snapshot, workgroup.

B

Alcohol reaction, washer, open SPSS, Asiago, shoot open, SPSS, limited inquiry, semaine de eco currency, amo, tab, Medina, Co kg reaction, panting, Lee, French, Edition, famine de aquila decision, Patrick approach, e ke, sensual, 800, organ function, momento sure, kubernetes, Reseda, Angela, omen et true Tao and príncipe de ja, vu de mundo. Tintin omen, faranzano, TV, Julie, gated, lndian woman who yo you millennium for integer, say ho. You know Michelangelo so.

A

Today we are going to talk about CRD customary sauce definition, but what it does and why it's important to talk about here, so we want to share story from us using CRD in your project, which inspired is talk, so our journey starts about a year ago when $6 a start, a snapshots project. You know, storage is for storing data, it is important and you don't want to lose it, but things might happen fix my failed data may be corrupted. So snapshot gives you an easy, quick way to recover your data.

A

It's very much like taking a picture of your data and later you can recover your data from that point. So we work very hard for this project since it provides such important future for storage. So we define API for volume snapshots. You know like other communities api's it tells us them what to do and controller manage the behavior based on API, and then we present the design through six architecture.

A

You know there are group of people have this power to decide whether to accept your API into export, so we hope to get their approval, so we can add snapshot into the core. The user can see. I used, snapshot, API, guess what we got rejected, so they told us no and to use the RT set at that time. We had many questions.

A

Why why push us out why they have to do this out of out of tray VCR D isn't for like third party application thing doesn't mean our feature is not that important and should not be part of grantees and sing to remember. We were very hard trying to change their mind. It's of course, I. Remember.

B

That we tried many different ways, trying to prove that natural API is, you say, entry and as the architecture was wrong. But after many many runs of discussions we finally change our mind and we agreed with the decision to.

B

Understand from the architectural point of view, let's go back in time to the very beginning of kubernetes into a 14. The first PR was immediate into the communities. Ripple communities was born into 15. We had to the wondered start or release early this month, humanities just has 10 years old, happy birthday, kubernetes.

B

Kubernetes grows fast when it was just a little baby boat. It had a very small number of API and controllers and support very limited features. Now, at five years old, it has grown into a much bigger boat, with a lot of earthly lights and controllers a lot of functionalities. Do you know how fast kubernetes has been growing to find out how fast communities have been brilliant? Let's take a look of the number of API types in Queenie's core to measure the growth rate in release 0.4. They were owned in 1988 types.

B

Since then it has doubled and tripled. Do you know how many API types were in release? 1.10?

B

It is 110, so that's almost six times as many as what we had in release. 0.4.

B

With this growth rate, can you imagine how many other types are in the latest release? 2015 I will tell you the answer later.

B

Are we expecting kubernetes to grow into this scary when it is giant? How can we possibly manage and maintain such a giant?

B

Obviously we can't it's time to put a stop and say no more. We can no longer keep adding edgewise into kubernetes core like this.

B

Instead, what we need to do is to make sure who na DS is truly modular, extensible, easy to add new features and maintainable with a minimum for.

B

So how can we achieve such a goal? Genes only tell us how CRE comes to the rescue.

A

So, yes, to explain c rd I want to use this urbanised is to transport. Anyone read this book before it's my right, so I want to use it here, not because just the cute pictures is because the book explain a concept in such interesting way. I want to share with you. So imagine. Kubernetes is a big zoo full of animals and we have API to represent animals and we have controller to one item. You know, kids always want to see something new something funny and we keep adding new animals into the zoo about something.

A

Not even this like this hippo giraffe like this make with big ears, how are going to Adam. So here it is. First, we call something the API already in the 90s resources. You know like Parsifal set deployments rest and if you want to define something new, something on your own, we have customer resources, so you can define any way you like you can define something really weird like part little errors or number six modem and Ciardi cotton resource technician is used to define those see ours.

A

Next technical cat example with this cute little panda- you know everyone loves panda, so a website CRD that it helps you we're going to define a new kind called panda and we want to add it into animals group on the right side, see our it defines the details, bag of this new resource panda and you can give a name you can define the spec like for stage, plays, wait now with CRT.

A

You can add the customer resource into the API, so you can use it just like other places API, but it doesn't do anything yet until you add a custom controller to manage it with CRD and customer controller, you get something to call the character API. That is really what component is all about. You know the API spec defines that is our state. What system look like and the controller will move actress page? What, with our state I hope, I explained CRD good enough and seeing we want to talk about our journey yeah.

B

Sure so now we unseal better. Why saqqaq culture want a push, it's natural, it has all the tree and how CRE can help us extend kubernetes api. We started to work on the snapshot feature.

B

We created our repo under kubernetes ESI. We added theory definitions. We added a controller to watch the snapshot. Api object, we added a deployment, llamo files and documentation. There are a lot of details here, but as a user, you really don't need to know from a user's point of view. It works the same as any other communities, a chai incriminated, Score API. We already have TD PDC, hard nodes, and so on now we have also added volume snapshot ATIS into the API assembly. You can just use it the same old way.

B

You can do cube categories to create a snapshot, a peer object. You can do a crib color delete it delete it. The snapshot controller will be working hard behind the scenes, making sure that users request is taken care off.

B

Now, you may wonder: does that mean CRT is exactly the same as a native API. We have to say that there are differences. Crt is still beta. The plan is to bring it to GA in the next couple of releases.

B

Crd already has many features available in native ignite, for example, before in validation, open API, v3, schema definition and so on. Northern efforts have bridged the gap between A to C, R D's are becoming more and more like native applies, woody snapshot. Ert is part of communities. It's owned by sweet storage as end-to-end testing it has official documentation, users can use it just like any other. Kubernetes storage features like position avoidance and more and more CSS Rovers have implemented a snapshot feature. People also started to implement more advanced functionalities like data protection and disaster recovery.

B

On top of that, so now you have heard our story. We successfully added what in snapshots. You are the elder tree as a core kubernetes feature.

A

So great, finally, our story has a happy ending. Now you probably get interest in CRD and want to tell yourself like how about to beaut the CRD for this cute panda and create a controller to monitor it. Is it easy to do so to tell the truth? If you do it manually and from scratch, you have to go through a lot of steps and have to understand code structure where well. The good news is.

A

We have some excellent tools, help us so here, for example, cubular one of the most commonly used tool to help you to create, publish, Yoshi rdap is and build controllers.

A

With this one, two three simple steps: you can create a project, you can define a new CRD api and you can build and run your controller, not easy, so to prove we're not lying. We want to show you a demo with this panda people from Shanghai already know her. She was born last year and her name is little princess, Chinese, name chichi, and seeing do you want to show everyone that how we can use panda, CRT and controller in two minutes sure.

B

So first we create a new project for the kubernetes zoo using computer in it. With this one line, we will have a new project created step, two to define new API for panda in the animals group using computer, create API. After this we already have a project and with files populated in a project. Next we add CRE definitions, so in panda type start go file.

B

We will modify pandas back, we added a birthday or per place and birth weight in the spec and in Panda status we added age weight, blender consumption. So later we can check whether she eats well and growth. While next we add controller logic. So we go to the Panda controller.

B

Here we go to the reconcile routine; now we find Panda based on kind of name, and then we just update and as status.

B

So after that we're done with the controller logic. Now we install these into kubernetes collector it's installed. So now, let's take a look of the cre manifest we just installed.

B

So this is the cre definition for panda in animals group.

B

Next viewed around the controller manager: now we have the controller, our name, we can test it, so we have a spec for panda chichi. It shows that for birthday she weighed only 6 ounces at birth. She was tiny. Let's check how she's worried now we're going to create a panda again object for her it's creative. Now, let's take a look over status.

B

It shows that she is 11 month old. Now she is about 10 tons of them for each day and her weight is 60 pounds. The shares grow a lot. His birth she's, healthy.

A

Great, we did it in two minutes. Yes, it is easy. Please try it yourself if interested. So before finishing our talk, we want to review the artist history to get a full picture of it. You know at the very beginning they already has a different name. Third party resource, the PPR. You know people want to try out their ideas TPR for the first time gives you a way to do it also super nineties without adding your API into playlists core. Of course. At that time it has limited features now over time.

A

Themes has improved a lot as a lot more features, and now people start to realize that I needed it I'll be using it and they start to create application operator to manage their own object today, not only just for prototyping and for applicant operator, but they have shown how to use the Rd to expand communities. Api corn, with this capability, we don't longer need to worry about, seeing that when I joined and what we are going to see.

A

Is this cruel, nice blessed freak with the corset in the center, which is easy to manage easy to maintain and we can add other components alongside we add modern snapshot and we're going to add a secure and hook volume group application snapshot just name a few imagine we are going to if we are going to add all of these into the core it'll be one eventually blow out.

A

So remember, seeing give us a question to guess the number API type we add in current release. What number did you guess seeing already to give us the answer.

B

Yeah sure it is a 113, so it's actually almost the same as what we had in release went out 10, that's because the architecture has already started to limit the number of api's that can be added to the core.

B

Let's look further into the future. We have a vision. This is afrin King Haakon the quality pioneer. He said that eventually everything will become or ceoddi, except things to run CRD. Of course, it's still a long way. If we can really realize the solution, there are version, compatibility issues between CRD and the core qualities and also insulation. Theory is a separate step. Also. We need to figure out how to better handle the ADIZ dependency on Kawai native core and so on, but we hope that with hardwork, eventually we will get there. I believe.

A

So too, and I hope you learn something from a journey to. We cannot cover all the details in to any minute, so here a list of references- and you can check on later for more details, of course just asked to present work, but it is Bethany a teamwork. We want to thank everyone, work on it, and last, not least, this is our connecting mission. Please join us for further discussion. Thank you. Thanks.