Cloud Native Computing Foundation Kubernetes Forum Seoul 2019, 10 Dec 2019

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Running gRPC Services for Serving Legacy RESTful API on Kubernetes - Sungwon Lee & Hoseong Hwang

Description

Don't miss KubeCon + CloudNativeCon 2020 events in Amsterdam March 30 - April 2, Shanghai July 28-30 and Boston November 17-20! Learn more at kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects

Running gRPC Services for Serving Legacy RESTful API on Kubernetes - Sungwon Lee & Hoseong Hwang, Buzzvil

gRPC is best suited for microservice communication. gRPC is fast, clear and powerful. It is an excellent alternative to address the verbose client problem when architecting a microservice infrastructure.

But the legacy environment is always a big hurdle for changes. You must support existing clients that only understand RESTful HTTP API. In other cases, you need to provide RESTful APIs to the outside world. This session suggests solutions to resolve these problems.

The session covers:
- Why the team chose gRPC as the inter-service communication protocol while moving from a monolith to microservices and the challenges they faced.
- How they leveraged Istio to support RESTful APIs using gRPC servers without additional development.
- How they set up CI/CD to deliver API changes (including legacy API) using Helm and Spinnaker.
- What they have learned through it and future improvements.

A

Hello. Nice to meet you. Yes, I will start a session to support SPL API in our main rpc service..

A

My name is Seong-Won. Lee. I am developing and operating the todd platform, a recipe for Busby & Tech Company, with Sung-Hwang Hwang,, who is coming up for a while. Before starting today's topic, I, will first explain why this is necessary.

A

Briefly about why we came to use a jewel pc, why we had to support El's spray pi, despite using a geothermal pc. I, would like to tell you, to get into this,. You need to know a little about the advertising ecosystem. Those of you who are already familiar with. It will know well,, but the advertising ecosystem is much more complicated than you. Think. There will.

A

Be a lot of publishers, and from an advertiser's point of view,, there are many people who don't directly run advertisements. For those people,, Ed, Media, Agency or Maddox should pay a lot of attention. In order to.

A

Send it to the user,: there must be a lot of data about the user. At this time,. A lot of information is imported through mp after the third party.

A

In addition, as a platform,, we are increasing user participation in advertising by using rewards as a platform,, so we have to pay rewards.

A

Since it is such a complex system,. It can be seen that it was almost essential for us to apply a microservice architecture while doing ad tech to microservices.. What you have to do is also among those requirements. Well,. If you think about it, the page pops up,, but the ad pops up after 1 or 2 seconds.

A

So, choosing my pc as a puff was a very big advantage.. The other was that, as we went to microservices,, we needed an interface tension lang banner registry to determine which API each service had and which interface it had.

A

While I was thinking about what to use for the registry,. There was an advantage of being able to automatically take up to the e point when using the jewel light.

A

As you know,, our main business is b2b. Then. There must be publisher partners who used the API. We already provided. We.

A

Had to do it for the partnership, and in order to expand our business,, it's actually the most loved rest api around the world.

A

Then now 5,, then we have a sin: pc, we always have to support both,. But how can we do it? If, you think about it. Simply, we can make it. All. You have to.

A

Do is stab the standing transcoder service. Then,. He will receive the jathon request, convert it into a sin. Pc request, then receive the sin. Pc response,, convert it into a jthon response, and send it to the clan tent.. It doesn't look like it,, but the api was changed. Here. I took server 1. I'm a bit concerned about the fact that there will be so many side. Effects. I thought the management poster would be very high.

A

So, if you look at it now, as we go from tick to microservice,, all the things that can be increased have to go into the microservice.

A

By providing it, each microphone service was able to focus on its own business. Logic. One of the most important things is that the network logic owes it and escaped from it.

A

How Istio configured this? Give me here: service a is our business logic service b that we talked about earlier. The.

A

Mv proxy we use was thankfully, supporting the pc to take and the first line tres coding.

A

Still,. We thought it was almost a free lunch and started to proceed in this direction. About. How these could proceed. I'll, give you a brief, explanation. First of all, to use the sin pc,. You need to determine the interface. The sin pc is using the ID of protocol buffer. Even. If you.

A

Don't do anything,, it will automatically do this. Transcoding that looks n Yes, thank you,, but my brother looks like this. It's a.

A

Part that uses the bottom of the sight to blow the likes,, but no matter how you look at it,, it's a bit difficult to see that this is a rest, release. If! You.

A

Use ,, even that is possible. It's the same method as before,, but there's one annotation that wasn't used on the actual PC.

A

We may need to put a query or put a body,, but.

A

We can also inject a value into a variable in this way and in that form. I'll try setting the nv proxy. In this session, I'm, not setting the mv proxy directly,, but I'm going to set the amount of nv filter provided by this steer through a file. If. You.

A

Look at each one,, they are set up very intuitively.. I'll use, the 100 m show mouse rpc, jsun, transcode. There is an.

A

Option called,, but if this option is not turned on,, the custom route that we set up earlier will not be applied. Because of this,. It could be shoveled,, so I brought it lightly.

A

Can we do it? We can only know you more than now. What. We use at that. Time is now our Toto descriptor. You.

A

Can think of the proto descriptor as a kid that has information about it from compiling the protocol buffer? We set earlier. If, you compile this and apply the path to the file as a trot descriptor, from now on,. You will know that Nam Boy is a service that looks like this, and you need to transcode it in this way. There are two ways to inject this..

A

The above is now It's injected through the file fact, and the bottom one can be put in a form that can be directly hit into a water file through base 64 encoding. It's.

A

Better with the settings.

A

I did it separately,, but I just set it to the extent of giving an appropriate demo response to the incoming request. This way, I can apply it. Then, by setting the gateway and bearer service, I can.

A

Lightly set how to make the incoming request to List Ace to go down to our bean. You can see it. Then. We can finally apply the mv filter. We set earlier. There are about 5 settings, now. I.

A

Divided the files I showed you earlier into the world and set the amount in the file. I applied the files through the ship, control., I'll.

A

Send you a request. You can see that the pc response has come well. If, you look at it,, there's a fit to take.. You can see that the same host is with me,, so you can see that the form has arrived. You can.

A

B

We are explaining, based on what we have implemented about how to continuously take the distribution cycle in a microservice environment, about applying when solving the mv first-line transcoder of the jewel pc body explained by Sungwon. First of all,.

B

Protocol buffer You can see that it is a kind of apr agreement between the server and the client.. This agreement is dependent on time reduction *, because business requirements for a certain service keep changing as time. Decreases. If possible, carefully It would be nice to set it up,, but in a trivial way, requirements such as adding a certain field and adding a new method will constantly arise. For example,.

B

If there was a blog service,, it is a way to express porting. If. There was a text,. You can say that you need a field like the front pair op chad, image at all., In that case, a new field is added, and in this case,, based on this proto buffer,, new server and client codes must be added to the channel to distribute each After that,. You are in charge of transcoding, and you have to update it in the way of song without.

B

B

B

If, you use a compaq called descriptor,. It is now a way to directly mount the volume of the pb file. Then, the front descriptor binary now encodes the contents of the file in base 64,, so the mv filter itself is a method without only 3. Two Looking, more closely,. Now the way to reach the proto descriptor is to.

B

Access it by mounting it in the invoice site that we will use now.

B

So,, how do you manage a certain call, and you will usually mount it in some external object, storage.

B

B

Now, I thought it was just difficult to control the self-distribution cycle of any api.. The second method is now a discrete binary, which is now base 64 encoded,. So if we look at it in mvp itself,, the readability will be a little lower,, but the difference will not interpret it,. So, on the other hand, Since the tenor for the volume that was 2 3 a while ago is gone, m4.

B

Will be able to deploy a transcoder that supports a whole new api once the new binary of the filter is applied.

B

Whenever, it happens,. We create server and client codes for various languages, and the process of uploading. The upload has become a repetition.

B

Using, the protocompiler, we channeled, the language-specific life server and client code, and.

B

Created ci that was not 2c in the registry for node, js, salt and other languages, that were painful in our internal. Not, only this,, but now wrong. Proto changes In order to prevent corruption, because it shouldn't happen,, lint or some field is deleted or renamed, etc. If. There shouldn't be a little bit,. Then we set it up like a ret to detect baking changes in advance. But. All these processes are delicious,. We also blog It has nothing to do with winning from the service Hanam,.

B

But since new business buyers such as comments or a user management area are added,, it is inconvenient to repeat all these operations. When writing.- This.

B

Hall does not make a post by collecting the registry together. By doing this,. You can now put all the api definitions used in our organization into one pagetoria 4,, and if you look at the 8 trees, below, a new domain will be added in a directory called Packages. Every time a certain Pro Turbo file is put in and changed. Whenever. There is a change in the Pluto file,.

B

My ci will turn around and I will be able to check Mint and what baking changes for new radius matters, and the changes will now be reviewed and integrated When. This happens,. We now have a flow inflow that will make a bush in the library creation for each language. Here,. We now use a pack packet called Node js Node, Say Yes,, but this is now versioning for each api..

B

We will do this,, but we will use cement pavement and set the view so that pumping of the version can occur only for the specific api and changed api. By doing this,. We repeatedly set c idle for new services that are continuously added.. I was able to reduce some of the hassle.

B

Proto d. Specter itself,, which was explained earlier,, was now able to be created through these commands in the same way as creating live for each language.

B

Now,, we are using it as a basic packaging tool for application. Closures. As, you all know,. They are two very widely used, and we have been distributing all the services of Pro Mat Scrap 1 tablet for monitoring what many people use in plus people before that with Helm. Because of this,. The tram is very familiar, and then it is very easy to create a f par story that hosts the Helm chart internally through the chart, museum or some other grazing. I.

B

Was able to easily create a pipeline. Yes,, more than anything. Yes,, even objects to the target api that we need to deploy.

B

In fact,, since Helen Chart Helm sees any template as such,. It is a basic resource why it can be deployed very flexibly with any cr,, so we decided to let Helm control the previous and network settings like this. I.

B

Brought an example of how to package this process into a Helen chart. First of all,. It is not much different from a general chart in the case of a Tissot object for some basic salvation, such as t, playment or service..

B

I set it to fit,, but basically n Bistio now interprets the port as tcp,, so we didn't use it as an underground pc,, so it corresponds to tcp. So,. To use my rpc space pecan function like transcoding, m boy. Istio has to be able to recognize the report as an underground pc, porter,, but now I use the named port method to attach the port name to the disaster. Pc, or I will use the method of giving the port name with the pieceran prefix. If. You do n't set it,.

B

It doesn't work with the transcode anymore,, so it.

B

Would be nice to do the above. The parse that affects the label with the label. Key value determines whether or not to landscape the mvp hair. So,. You can see that you need to put almost the same content as the select in the service. And. This is the next prototype descriptor binary. Now,. You can think of binding the fruit of descriptor that you created by reducing the separate comfort buffer register to the actual deployment time.

B

Under the assumption that the api has been changed,, we will do easel food. Then. There is the Sang Helen chart,, and now we are managing the artifact storage separately for the values to be overridden for each distribution. Environment.

B

This is the information on how to get the credits quickly., In addition,, the protodiskrotor binary that was produced earlier is also taken from a separate artifact, repa story, and it is said to put it together and go 100 steps. I'm, not using a speaker,, but this is now a certain uncle cycle. More safely, and I'm.

B

Just using it to set up leaks and definitions after various monitoring or subsequent leaks. The use of Instrument, 2 I think the overall composition itself will be very different.

B

Now,. A few tips I felt yesterday. I will briefly mention the problems. Earlier.

B

In that case, now, if you use a certain type called Google api htv body and set a value there,, you can send a response other than your reason,. So if you have a scheduled situation,, you can use these things.

B

Then The rpc status of the rest, response,, the rpc status of the response, and the headers, such as the tc message during the day, are attached together and go down. It's.

B

Helpful. Well,, since we're now working on api based on the descriptor specified in the transcoder,. If a path or method that wasn't mapped there, appears, a 503 error subscription returns because it failed in the upstream. In this case, we now Oh,. It can be mistaken that a response is coming because the setting is wrong,, but that was not the case, and it was simply the wrong path. In. This case,. It would be nice to receive a more meaningful response like 404 or imagination, When.

B

We can't find a way to do it, if you know,. It would be better if you let us know., And now,, since it is mapped for a certain route that came through the virtual service of the mv filter, itself, uh,, using port forward,. The prosthetic service Traffic that comes directly without going through port-forward will be routed. So,. We will do a lot of tests through port-forward. Then,. When we call Rest & Pasta pr,. We will not respond anymore. Now,.

B

If the service end point is done directly or through Ing, well, I was able to confirm that the day is coming.

B

Now,, the last conclusion. Well,. Now we have explained this overall pipeline very simply,, but it runs smoothly for manic requests. It took quite a while to set it up to be able to do it, but now, as time goes by, when I create a new service in front of me, when I say, let's create a service that supports transcoding, I was able to make it very easily by configuring. Only the jrpg server.

B

This is now another team In case gr. Pc is not ready to be used yet,, but we want to develop with pc. That's the case. Yes,. We can talk like this with ts coded lsd, api,, which is also used when developing with underground pc.

B

So, this color So,. Since we have my prototype file in the idl registry that leaks into some dinosaur dinosaur,, we directly review each other and start developing from the result,. So when we create a new prototype and blow it up,, we review it overall within the organization. Development can begin after the design of more stable and reliable APIs is completed first,. So we were able to make the API 8 stuff, more naturally melt in and out of the initial competition,.

B

So the overall SEBA post suggests time. So I think that it has become very detailed. If. You do a little more,. You can see it. Now. I made a sample repa story and uploaded it. I.

B

Think it would be useful to refer to it because it is written on foot. I will finish my presentation with this. Thank. You.