Antrea LIVE !!!, 25 May 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Episode 29: GPRC and GOLANG_PROTOBUF_REGISTRATION_CONFLICT ?

Description

Whats this GOLANG_PROTOBUF_REGISTRATION_CONFLICT that i keep hearing about ? Lets figure it out.

protobuf: serialization/wire format -- IDL
grpc: http framework that does RPCs using protobuf
Kubernetes
CSI: native to the specification
CNI: ? not yet 2.0 ??? exec
Kubelet:
services, messages, enum
service
endpoint
watch
…
rpc Watch() returns (stream OpItem);
containerd [exec] - /opt/cni/bin/antrea - stdout , IP parsed ?
opt cni bin antrea - ( GRPC ) - antrea-agent (on a port)
pkg kubelet cmd devicemanagerd manager.go

A

B

Everybody hola here we go vlad's dressed up he's dressed up in all blue for today. He's.

C

A

B

Shirt and his andrea hat.

A

I wish wait, should I be getting an entry of swags.

B

This is gonna, be the best show because nobody's here. Okay, um oh no, two people just joined sorry um all right, yeah! You can get a shirt cool. You can get a shirt all right, so um this was, I totally forgot to announce the show, so I just put it on twitter like a minute ago. That's I.

A

B

And uh so I don't know, who's gonna come so this might be a quiet day, but.

B

B

The this originally the idea here, the thing that we ran into was this issue vlad. Do you want to introduce yourself? It's been a while, since you've been on the show. Everybody knows me and I mean.

A

uh Vladimir staff at vmware.

A

Do everything in go.

B

B

Registration he's also the author of crash d and tl for sauna buoy over here.

A

um I guess you haven't heard the switch. What's that I'm switching I'm going to a new uh bu. Oh, I probably should I probably should post something somewhere where you hang out.

B

You didn't tell me that oh pair is here pear and jun. Jen is here okay, so um no, I didn't know that I did not know that uh at all. Where are you headed uh vlad cebu.

D

Oh how'd, you end up really.

A

Yeah well we're doing some time good stuff with um with edge so.

D

A

B

Okay, well you'll have to tell me about that sometimes so ignore okay, so we saw this golang protobuf registration conflict. Have you ever heard of that before vlad.

A

B

A

B

Okay, so we ran in this one and um stoyakas. I will give you the stream yard link in case you want to actually join the stream.

E

E

B

Okay, I gave you the link if you want to join the stream andrew, so andrew and some other people had mentioned this golang protobuff registration conflict. We saw this in kp g recently and I realized I haven't looked at this protobuf stuff in a long time, um and I think the first thing that I think we should probably talk about is like protobuf. Where does protobuf begin and grpc began right? So.

B

Everybody say hi to amim. You know he's the windows tl at uh at um vmware nowadays for kubernetes. I love folks.

F

B

So who wants to answer this one for folks that are new to grpc or protobuf? What's the difference.

A

Grp uh protobuf is the wire format, it's the binary wire format and it's driven by an interface. um uh We call it definition, language, yeah,.

E

A

Idea, uh grpc has more of a framework built on top of http that allows you to do as it's in the name. Remote procedure calls and the energy, the interchange, format and grpc is put above by default, but can be other wire format, but most places use um protobuf.

G

Yeah, have it tried to use another serialization library beside you, protobuf.

A

Well, no, you well protobuf! You don't have to pair protobuf with grpc at all I've thrifted right so thread. I don't know if they've done thrift, but I mean.

H

I don't use that roblox.

A

By itself, you can use protobuf completely by itself as an interchange, format.

A

But grpc gives you not just the protocol for our format, but you um not just the uh wire format, but you have the rpc. Give you a whole bunch of stuff.

B

Thrift has exceptions, it says vlad.

A

Has exceptions yeah.

B

Is that, like protocol buffers, have much better documentation? Thrift has a built-in set type. Protobuf protobuf has extensions. You can extend proto to add extra fields. What is that.

A

B

A

Yeah, um you definitely can add extension you can, you can have you can create what they call compiler plugins to extend the product protocol buffer, compilers.

A

Yeah, that's that's all I remember, um but it's it's it's very. I mean it's. It's getting to be super uh super popular and it's not just in goat and go I mean if you go in and like dot net and um rust and those guys there they have pretty solid grpc implementations.

B

Okay, let me do some little bubbles so that everybody can see that people that are watching this without actually watching here we go. This is my favorite part is when I do this and then I click on it, okay, so andrew well, you saw this issue the other day right. You saw this. What was it which.

F

One, I didn't, I don't remember, seeing any grpc issues.

B

I thought you had a grpc issue: okay, never mind.

F

I was hitting a build issue, so we were both talking about issues. I guess.

B

You were working on a different issue than the one. I thought you were there. Okay, someone else was talking about. So do you know anything about grpc, andrew.

F

uh Learning as I go.

B

F

I'm not an expert by any mix, but I've.

B

Utilized those.

F

Servers a few times you devise a gp grpc interface.

B

Yeah, let's open up the kpg, so we can use that as an example- and we can talk through this because I know you're deep in this code right now,.

D

A

Every time I see kpng I'll, think of the financial thing.

F

Yeah, whenever you google kpng, it always tries to autocorrect to kpmg yeah.

B

Navier was yeah making jokes about that the other day; um okay, so I'm not going to introduce kp. So where is our schema? So jesus.

D

F

I'm looking for the protobuf schema, um is it not in it? I could be wrong. Api api is.

G

F

F

B

F

Right, well: okay, services underscore grpc.proto. I don't know what the difference is there.

B

Oh damn, oh, it's like pretty the difference.

A

Well, go: this file is what's generated by the compiler yep yep yep, and this is the definition. This is the ideal yeah.

B

This is the idle, so syntax proto3. So there's I guess, there's different versions of protobuf there's.

A

A third one: yes, there is a second one, but three is what what when folks are talking about. Grpc right now is usually three.

B

B

So the first thing I see here is there's a service type.

B

Okay, so there's a service and a service represents.

B

What is it so? There's a search. So let's look at the types there's services, there's messages.

A

B

A

Your services is a grpc uh construct.

A

The other stuff messages is what makes up your your your wire format.

B

Okay, so there's services, messages and enums and then.

D

B

You're calling this the wire format.

A

uh Yeah, that's that's. The message is what you use to define what you want to send.

B

So that's that's like I like that, because see me and me and vlad are kind of old. So for us they're the only way to send information used to be through a physical wire, but.

B

So we call it the wire.

C

A

Well, it still goes over the wire, even if it's uh wi-fi, eventually it'll land on the wire somebody you're.

B

Right, there's some metal electricity thing somewhere connected to something right.

A

B

B

So each one of these messages.

B

Represents the thing that you send right wire right.

A

So the service describes an end point, an actual endpoint that you can use to to uh that. Your client can reach. So here we have a service uh called and all right. Well, let's call endpoints.

D

A

And inside one of the method is called watch.

B

H

B

Okay, so in this case we have a service that service has an endpoint.

F

More service and endpoint term overloading.

C

F

Oh, my goodness, yeah.

C

That's a bad name for us.

B

And service is also.

C

B

We can we find something else in here.

F

God, because that's we're talking in terms of grpc, not in terms of.

A

F

B

Yeah, this is really okay, yeah.

A

The endpoint name is just the name of the service. It just happens to be called endpoints, which is kind of a bad name: cool, okay,.

B

Well, let's find a better one, so so we need him. We want to find a message, but is this the only rpc it would really suck if the only rpc in our entire example here was okay, here's another one.

A

Called global yeah.

B

And then it has this watch.

A

So and it takes a stream of global watch, request, object or messages and.

B

What why is this empty.

A

uh Because it's a is it a request? You're not saying it's like a so in in grpc when you define your service, your rpc method has to take, has to take a message, even if you don't have anything to send.

A

So that's why this is empty.

D

B

A

B

You can't do like what you do in goling, where you just.

A

No, you can't just have watch hanging by itself.

B

A

Like you would in go, or in you know, other languages, you would take out that um you would take out that parameter the uh argument list. All together, you just remove it, but not in not in um idl, for for the rpc yeah.

B

Really, okay, but really it's this secret. Yes,.

A

Exactly that's what it is: okay,.

B

Okay, so okay, cool, okay, so there's this thing and it doesn't take anything so um in this case global is so so then, when I do rpc, um that means that when I do the generate it's going to generate some go code that I can run in one place. That's.

A

B

Then that go code will compile and it will. I can call this method watch in that go code and it will and it will what is this: how does this stream get implemented stream.

A

Is a type of um stream allows? You? Isn't it very interesting that in in grpc, a stream type allows you to actually stream data from your client? And this one is probably yeah? It's. I think it's yeah so because it's a it's a req, it's a request or it's a it's an argument stream, because you can also have response stream.

A

That means that when the client calls that method, it can give it a stream of values, not just a single, a singular value, but a stream of values.

B

But in this case it's being returned right.

A

The is it returned. Oh yes, oh it's both! So I didn't see that so it's both returning taking a stream and returning a stream.

B

So how do I find that is that how do.

A

D

D

Want me to do like half.

B

Half screen, I hate it when people are screen sharing and they only they keep jumping back and forth and they don't do a half screen. I'm going to give.

C

You a half screen now there you go right here, and this is the implementation.

A

This is what's generated for that for that um for that service, so you see type global client, online 140 and then all the the the rest is what implements the uh what implements the uh service. So you have the method watch um and it takes.

B

So does that mean that, like when I call this this function, if I was to call it, it returns back one.

A

Right it! So if you were to call this because it returns a stream global underscore, watch client is probably a type where there you go, then you can see how you can do send and receive on it. So you can do receive and.

B

Oh and it has a stream in it yeah, so I can so that's a field.

A

Yeah, uh it's it's a field, but uh grpc.

H

A

Take care of wire, you know plug it in where it needs to go, and then all you have to do is sit there in your code. um I think it's, uh I think you get a channel.

B

A

B

Yeah, you do get a channel.

A

Yeah and then you can just sit there and look through that channel.

B

And so when you generate the proto okay, so so, in other words, when I do, when I generate protobuf stubs, I'm gonna is g. Is protobuf smart enough to generate an actual golang channel thing for me, yeah.

A

You get so pro uh the remember I was talking about compilers, so there is a compiler, a printable or grpc, um there's a compiler for grpc for go um and it will generate everything that you need, including so, if you're writing uh it'll do the both the client and the service.

A

And actually let me send you a, let me see if I can, I mean if you're really interested, because I I have a.

D

You're, the crosstalk.

A

D

None of those no.

A

I was gonna say I have a github. I have a github uh repository where I wrote. Okay, like tutorial for this, and I know I have like very like a very simple example that walks you through all this stuff.

D

A

All right, I'll I'll dump it into uh I'll I'll, get the uh url and dump and send it to you. Yes, sir.

D

Okay, you hook me up with that.

C

B

Vlad saves the day we didn't know what we're gonna do today and we didn't, and then we decided what we're gonna do and we didn't know anything about it and then vlad just decided to just show up and make us.

E

All look make us all grpc.

G

That was a good shortcut thanks.

F

Yeah plus one learning a lot, I want to see those repos. You were talking about vlad yeah.

A

I'm I'm grabbing. Can I what's.

B

Taking you so long hurry it up already.

A

All right, I'm gonna put it in, uh I guess comments or private chat, which one is better. You can.

B

Put in comments all right.

A

Let's I'm gonna dump it in oh wait. I can't put anything in the comment: I'll put it in private chat and in um in stream yards.

E

Here we go okay, there we go here here. He goes. Oh vlad!

E

Oh man, okay, here we go.

B

Okay, here we go so.

A

If you scroll down and in the read me, I think I kind of walk you through some of this stuff.

B

Oh nobody's ever going to believe that we didn't script, this they're going to be like. Oh you and you're updating it.

B

You're you're such a boy scout, so you made this like five years ago and you updated it just a month ago.

A

Yeah somebody probably sent me something say: hey.

B

Something's broken okay: this is cool. I don't know anybody who maintains their github repos for five years.

A

Well, I mean I.

B

Don't delete it. That's awesome, 143 stars vlad. You know they say if you've got 50 stars, that's enough to get 5 million dollars for seed funding. If you're in the valley is.

C

That how it works not in florida yeah, I'm sitting on a lot of cash dude.

B

D

um Vlad is eligible for.

D

B

Cool, so um I can run this right.

A

Yeah, so if you go go up in the in the in the repository itself, there should be like a starting one, I'm looking for like a simple example.

A

Oh so this example is, I think how you can it's it's just protobuf remember I was saying you could just use protobuf without grpc, so I think that's what that example is.

B

C

All right, so this is just a raw protobuf you're, just generating.

A

C

Services, if you look at the, if you go and.

A

Look at the proto you'll you will find. Oh, no, there is a service. Okay! Maybe I'm wrong.

B

This kind of grew into something it wasn't meant to be huh yeah, that's fine, okay! So what there's a simple one though off.proto this is like a raw proto.

B

A

No, this has grpc.

B

A

Yeah, I think um I'm trying to recall all of the examples. I think I think I have a list of all that tells you what the examples are in the read in the in the documentation: okay, but yeah. So any and everything you might want to learn about grpc as far as starting is this like the grpc book?

A

Okay, uh I tried at one point, but I gave up.

B

If you, you have a book about golang book, vlad has a goal: link dude, I do. I do have a go book um go and the grpc framework. Let's just pull it up. Vladimir vivian.

D

Golang where's the book.

C

Where's, the book vlad you just you just clicked away from it, learning go.

B

Right so I could buy this go on amazon, yeah, dot com. Unless I change shortages, you could buy this book right now: okay, yeah, um if you are reading this chances, are you have some familiarity with go and are looking to start working with grpc or maybe you have been working with grpc in a different language?

B

The repository is a collection of code samples that showcases grpc go framework before we jump too deep. Let's start from the beginning. Okay, so let's establish a scenario: we have a financial provider that wants to set create a currency service that allows us to look up the validation, okay.

B

G

To I wrote all this.

B

You wrote this that's great man, so, okay, so I've got java. I've got different. Programmers everybody's writing, a different programming language, it's the tao. What is it the tower of babel.

A

B

A

B

In the enterprise, okay, your first reaction implements, which may be json http rest, implement an http based api server, you're right. This is great vlad and um okay. So all right, so we don't want to do json all over the place.

B

So and then you say so because you probably did this in java, like 20 years ago, like.

C

B

A

So hey man, you gotta, you gotta.

F

You gotta show respect for the elders right.

B

F

B

Man, I'm bowing down.

F

Right now, that's crazy. I can't even imagine I was five. No, so.

B

Okay, so so when so when andrew stoickis was like five years old, okay running around in diapers vlad was writing soap-based web technologies. That's.

H

B

He was, he was writing a big xml file.

H

On uh running on uh weblogic- oh my goodness yeah so.

B

You would make a big xml file and then that thing would generate a whole bunch of java objects for you. This.

H

Used to be how you.

B

Would access the european bioinformatics institute uh instead of a rest api? It was cool because you could write a massive java program. I I use that in grad school um and I remember I used to love soap man. I don't know why it went away, but um you know.

C

B

I I don't know I accidentally, I don't know it seems like it came back because, because guess what we're doing now, grp what it why? Let's see xml sucks encoding soap, was resource yeah.

A

B

We're meant for machine but created by human, oh interesting yeah, so, but it was real similar to what we're doing now with grpc I mean it's really.

A

Close the idl and grpc.

C

Is is meant for both human and machine. Arguably,.

B

But I mean from an end user perspective, I can take a soap client and pretty much run it the same way. I'd run a grpc client right, yeah.

A

But the tooling was clumsy and there were concerns bleeding over other concerns.

E

A

All over the place, um no, this is by far an improvement to me.

B

Yeah I mean yeah.

A

So the the wire format in soap was angle brackets in clear text, and here the wire format is binary.

B

D

A

It's faster and yeah smaller the whole night, so.

B

Exploring protocol buffers so here's a pro, so this is how you would.

A

Yeah, this is a functional protocol buffer. This defines a type currency and its constituencies, so in languages like go, this would turn into a struct in java. This could end up being a class.

A

um You know whatever container types that you have in your language. This is going to get translated to that.

B

So now I take this and I um well since it's an andrea show. I don't know if june jenner or anybody has any thoughts. I hate chinchi.

B

um I don't know whether there's any attempt anybody's involved in the attempt to move cni over to using grpc, so it turns out they're not there. Yet I have so not yet 2 2.0 right they're, talking about having cni providers.

A

So how does it work today? How do you I mean it's an exact call.

B

Yeah so when container d makes an like a cni call, what right.

H

B

Right now is container d, um so when you do like c- and I add or any of that stuff I mean it's basically running- you know, opt slash, opt slash, ben slash. Whatever your cni is it's. It's literally calling that as a binary.

A

Right, but right is there: I mean it's a network anaphase. What what's the interface is there? Is there a definition of all the the arguments that your your binary supports as a provider.

B

Where's, the c we did a show on the cni specification, so they have a spec okay um and I don't know if they ever actually talk about the exact.

B

The way things are exact now this is when, if there's anybody from the entrance folks that are still here june, jen is here here we go so andrea uses grpc between cni plug-in executable and andrea agent. Okay, all network interfaces, so so above the cni. So.

H

B

You're, a cni provider, you know nobody's going to stop you right from from using using your.

A

However, you right yeah.

B

As the implementation detail of how you, how.

A

You, the implementer, do it okay,.

B

Exactly but the but the executable itself, like when container d like if we go back here.

A

Yeah, there's got to be a uniform way of passing those arguments.

B

So container d does literally like an exec right.

A

B

That that calls like opt c- and I been- I don't know what the entry or whatever that is right and um that that literally then returns standard out that returns, so a string to standard out right and then the you know, then the ip can be parsed out, as I recall um pretty sure, that's how that's working right now and then, but what I think june jen is saying, is opt cni bin, andrea that talks to the andrea agent.

A

Right that are on the node.

B

On a port right and that that is this whole thing right here is grp.

A

Right and that agent is, is on each node right.

B

A

B

Yeah, that's the oh. He gave us a link, let's see, okay, how do I copy a link from this stupid? Show thing.

C

A

The comments isn't it you should be able to there. You go.

B

E

Go ah there, it is okay, I mean here we go.

B

Okay, so now a meme: where are you? What is this.

E

Here we go there, it is okay.

B

So when I started up, I'm starting a new grpc server, app.

A

B

And um that's the same: if I go over to someday, stoichis is going to work at vmware and he's going to be working on an andrea problem with us.

F

Yeah yeah we use grpc internally at red hat too I'm trying to I've been trying to look for the code.

A

Right now, yeah.

B

So you could see the same call where you use the same thing in kpc's.

H

B

Thing right: you start this grpc server up and we could see it's being used, so um I jumped over to that because I I just kind of realized we hadn't, we hadn't, really talked talked much about how this applies in the real world yet and some people might be wondering like. Why are we even talking about this today? So um so the cni there's csi, um there's the kublet right and then the kubelet.

B

Does the kublet make grpc calls out to things.

A

Not that I know of um no okay.

A

I know there's a there's.

B

A lot of caps about it, which is why I'm asking? Because they say a.

A

B

A

B

See all these sig node caps that talk about grpc.

A

Yeah there's a gr, I believe there are grpc calls in between some of the controllers, like the like the validation there. There are some pieces in in um in the validation chain of a request that are done via grpc. If I remember correctly so.

B

There might be some internal, so this is a okay. This is a homework question for folks. Where does the kublet use grpc? We don't know, I don't know if anybody knows t-shirt, yeah.

A

Container runtime is one of them. The we already said, cri right uh csi is another um and I believe, there's some places in between certain components like maybe like I don't know, scheduler and something else. I don't know there.

B

Might be other places, so it may be floating around in different places right so yeah so, um and I wonder if I can like can I grip this out like if I go into the source for k-8s.

B

I just get: can I get grab this while I find it, do we ever just do that? You.

F

B

A million new.

F

Things yeah yeah.

B

Not much device manager.

C

Oh, that's the other one device device manager, okay,.

H

I know there was, there was one more.

E

B

There we go cool, so we actually do use it in the kubelet device manager. So that's probably one of the okay cool, so the devices when you, when you do stuff like grpc and stuff, like that, okay, um so back to your repo here, um so I can, if I so, if I grab this, I can let's see, let's let's run this one right. So let's do it. Let's do the hello world right.

D

Oh okay, cd source, let's clone you get clone that okay.

H

D

And the name of this file is vlad.protalk.

B

Yeah, you already have.

A

It you should already have that.

B

I'm sure I have product yeah I mean I'm sure I have.

B

Okay, so oops, I meant to do this. No.

A

What I'm saying is you don't even have to retype this? It's already in the um oh.

B

You mean, I already have the.

A

Yeah it's one of the examples.

B

Oh okay, I just use your thing well, whatever too late at vlad, okay cool. So so I could do that and I could generate this file.

A

Okay and now this file is ready to be compiled and used.

E

A

But it's not grpc, it's just a way for you to exchange uh data, those messages, basically over the y.

B

Yeah, so I could I could compile this and then I could call these methods and they would return these values. I made I made a javabean right, so yeah, okay, so now.

A

In fact, if you go back to the to the to the repository, it probably shows you how this is being used in the example.

A

Okay, I was being called.

B

So, let's go back to your original repository.

A

Yeah, if you scroll down so this is these are the types that got generated um and so currency got generated and now it's being used so now we're using it. So basically what this example is showing you by generating my own wire format, I can use it to store data in about and basically in a file that stores the data as a binary format.

A

B

A

um That was generated, okay,.

B

So I can take a csv file as input so.

A

B

In this example, you take a csv as input, and then you have um you have a you, have like a parser that you write yourself.

A

Yeah no, the parser is what was generated for me.

B

Who's parsing: how do you, how can it parse csv.

A

No! No! No! So that's what you.

B

Heard about this one, so you had to write this yourself. You had to read this.

A

Right here, right, yeah yeah, it's basically it's just reading some values and generating the the value. That's it's just uh part of the example yeah consequential.

G

So what what you are marshaling here is the list of the protobuf items correct.

A

Yeah, that's correct, wow! uh It's just that the data is coming from a csv file. That's all! I could have typed it all manually. So if you look at that, csv file you'll see that it's um it has. The data.

A

Items file open.

B

But this currency list is generated for me right.

A

Yeah, let's look at the file, let's see what's in there.

A

No, this is so this right.

H

A

A

Okay, so all right, but you're gonna need the file.

B

Yeah yeah yeah yeah I mean I I I would need a csv file of some sort, but but that's not too hard right, because you're just parsing these rows out right.

A

um Yeah read see, let me see, because I got to remind myself what read the edgy content and return rows of. Let me see sorry.

B

I'm sorry I did that thing that I told you I hate when people do to me, yeah all right.

A

Return rose as okay, so the csv has the data and we return a list, basically read the data from the csv and return typed representation of that data.

A

That's all that this is doing so read the psv and return a type representation of that csv and that type representation is using a generated type from um from our um from our protobuf yeah. So that highlighted thing you have down there, that's the type that was generated from the protobuf.

B

And then I had just appending that to the list. That was also.

A

B

By the product yeah.

A

The list was also generated by the compiler, and then I do that just so. I can show you that yep, um once you have your data encoded marshalled as those types, then you can it be. It is protobuf. Now you can do whatever you want. You can do.

B

What I want- and I can send all these over and I don't have to aggregate some weird json, no.

A

List- and I don't.

B

Know whether to make it a list or a map or what the hell I'm going to make and.

A

All the types are com. You know it's strictly typed, so you you say you need a date. You get a date. um Yeah.

B

A

B

Like what you would normally yeah exactly so like you would, like you know otherwise, you'd be doing some kind of weird thing where you had to like look at the way to bulk upload things using a rest api and only upload 40 at a time and whatever else right, yeah.

A

Okay, only this this example does nothing with the data. I probably write it back into a file as a binary file that has my data now, but then.

B

It gets good because see now it gets interesting because you started with that, so you know we started with the little crawl, which is just here. You go: here's how you could generate a list and now we're going to make a proto. So now we've made this original.

B

uh Where was it this thing? This is the original.

B

This was the original. um What do you call this? This is a protocol. This is the.

A

uh uh Definition, that's the idea idea.

B

And then you're going to call this.

A

We're defined yeah so now I'm converting it into a service before it wasn't a service. It was just wire format. Now, I'm converting into uh uh into a grpc service.

B

Yeah, so let's look at the original one and compare it right, so you had vlad.protalk, which is here and then.

B

If you had vlad dot pro talk there and then um you have currency and you have a currency list and now what you're doing is you're? Adding this new thing here, which.

A

B

Currency request and a currency service right right.

A

Because remember when you have a your method and your service have to take a a parameter of some.

F

Sort, and does the service allowed you allow you to send that that data over the wire? Yes, so when the grpc compiler.

A

Sees the service it not only builds generates the types, but it will create http services and http clients. Wait.

B

When you say the grpc, isn't it pro protocol buffers? That's doing all the compiling right, but you said grpt compiler.

A

Well, protocol buffer compiler with a grpc plug-in. So if you scroll down again you when, uh on the page on the instruction you'll see when it's what we're calling protocol buffer now, we've given it a a grpc uh plug-in and if you keep going oh.

B

That's this thing. Yes, oh, I didn't know that. I didn't know that. That's how you do it. Okay, that's.

A

All it is yeah.

B

So, okay, so in here I do pro talk and I give it an input. What the hell is this input? What is protobuf? That's.

A

uh I think that's the path where it is or something like that.

B

That's like the folder that has all the protocol pro dot, proto files in it right.

A

I believe so yeah.

B

And then okay and then, when I say out, oh this is weird, so I do dash dash go output.

A

B

Say: okay, you're going to make this output, but when you make this output, I want you to use this plug-in to build the output correct.

A

Because protobuf supports many plug-ins and grpc has just happened. The protocol buffer, I should say, can have many plug-ins and and grpc is just one of them.

A

um I mean, and this actually is the go. Grpc plugin some other languages may have their own um native plug-in as well. Go is one of the few that I think has its own pla native plug-ins.

B

Okay, okay, this this helps me to understand it. So then wait so can we can we find this thing in our? So maybe we can grab around then well.

H

You will find.

A

B

A

B

This so in our make fall because I've never understood how we did this. There.

A

D

What is he doing here? Is he compiling the? What the hell is this.

A

Is it compiling it on the fly? What's going on how.

B

Do we do, how do we build it? How do we build the grpc when we do the kpng stuff? I think we don't even have that automated.

F

I haven't been automated anywhere yeah.

B

Like I think we literally have a secret static, I think it's like. We have to email.

A

Is it a github action.

D

um No, I don't know we're not that fancy.

B

We didn't even have ci when we first okay. um I thought I found an issue for this. Didn't I I thought I found an issue for um add: make target for grpc.

A

Yeah some pro someone probably compile it locally and then just save the generated file and push that yeah.

F

I'm gonna ask me huh so you're looking for the actual raw photo, not protobuf files, the raw grpc, like schema.

B

Yeah I mean why don't we I thought we had to make target for this.

A

Yeah, the raw the schemas are there. What's not, there is, how are you building them.

B

Yeah, we don't know, we don't have a make target for this right. So I think we have to ask vivek this.

F

To generate the go bindings, you mean yeah.

B

Right yeah, they.

C

A

C

F

And then tracked the file right.

A

Exactly that's all that's pushed yeah, so we.

B

Updated that we would have to obviously yes, I I swear, I filed an issue about this and it's like what did somebody do close the issue or something I don't know um or maybe got stale rotten or whatever? Okay.

F

Maybe I can go look into it now that I'm having.

A

Yeah, that would be awesome.

A

B

It would be great for us to have, like a you know, a hack, oh, no, we're going to turn into kubernetes we're going to have hack, verify, grpc and hack, make art.

F

No hacks take away the hacks yeah.

H

Whenever there's magic.

F

Happening in any cube, repo go look at the hack directory.

B

So, okay, all right: okay, it's 4, 50 and, um like that's, how it works man I mean this is.

C

I'm happy with.

B

Where we landed here, like we've, been able to go through all this we've been able to see how the proto buffs so for for folks that are wanting to understand this, like the the whole thing that we've sort of gone through today is the the proto protobufs as a serialization format, and then the grpc um the fact that, like when you use the protobuf compiler, you actually give it a plug-in that understands how to make um take these basic protocol buffer things and sort of like sort of interpret these service, this service stanza, so that now you can make.

B

um Let's see, I'm sure he pasted it right so like now, we get um where's the generate. What do we generate so now? The go bindings are well. We already had the go bindings, but now we're getting get currency service, server, right.

F

A service yeah currency service, server.

A

Right uh what was the question? I'm sorry, I.

B

Think these are the things. So if I look back here, if I look back um you added this currency request and currency service right and by virtue of adding those things, we now get this currency service server generated for us right.

B

Yes- and it also does it generate this request, also for us.

A

Yeah, so those are both.

B

A

All the types that you have in the idl will get a uh I'll go type.

B

A

B

Dot slash get commit, I know I don't I'm not. Don't worry, I'm not gonna pull request this. I know it's redundant, I'm doing it for the sake of the diff right. So now, if I go in here and I vim vlad.protalk, I get rid of all this and then I put this in here right.

B

So here we go so here's what we've added right: um we've added now: currency server, a currency.

E

B

A

B

This corresponds.

A

To the two things we've added to the original protobuf.

B

But we also changed the currency used to be a message, and now it's a type.

A

No, no, no, it's a message in the idl: it gets generated as a currency type and go wait.

B

Did I what did I do hold on? I I wrote the go lang over the I meant.

A

So the message that you have there, um those will get generated as regular goal types and then the minute you create a service you're gonna get a server generated for you.

B

Okay, so yeah, okay! So how come you got rid of the package? You should have kept the package vlad.

A

Oh, um I removed it. Oh you know what I think I specify it in the that's fine just.

C

F

Vlad, I have a question for you. What, um yes, is the main difference between so grpc versus just standard like rpc2? It's just that the data encoding model isn't with protobuf anymore. What? What do you mean by rpc2?

F

So I didn't I was looking through. I work a lot on other comedies and we actually use our piece just a generic.

A

Oh, the you mean the version at the top of the.

F

um Well, I didn't know if there's a difference between rpc and grpc or if there even is such a thing.

A

Grpc is a an ensemble of a framework that uses by default or usually uses protobuf.

F

A

And it's you it. It's always protobuf version 3. I believe, um but there's a there is a protobuf version too. If that's what you're, referring to um mostly.

H

A

Inside google much heavier at least from what I remember when they were describing it much heavier but very flexible, but version three of the protocol buffer shed a lot of the flexibility for simplicity. So the version three that we use that you'll see use all over the place.

A

um It's uh it's a little bit lighter than the version two. I haven't. I've seen version two somewhere, but I can't remember where, but I believe the protocol buffer compiler should be able to compile either one of them.

F

A

B

Makes sense so we can see now since we've added these services. Now we generate a lot more stuff here right.

H

B

We're generating a lot more, so we could see now there's these imports because we're importing so the first thing that.

H

B

Is protocol buffers are generating this.net context and it's this and they're importing them for us so that this file we can compile it in it's going to import all the grpc stuff we want, and then it's going to now give us this type of currency request and it's going to give us um all those functions around it.

B

um And then it's going to I'm looking for the server yeah. Yes,.

A

Right there you have new currency service cloud so generate both the client is.

B

This kind of this context is like a coupe, config context, kind of right. It's like this is how I connect to my server thing. No.

A

This is a go context. Oh that's.

B

A go context: yeah.

A

It's a it's strictly problematic context.

B

Where's the thing where you tell it where the when you initialize the client.

A

We mean well, if you go right above where you are, you see fun, stop mid mid screen. You have new currency service, client yeah, so this is the code that is generated for your for your client. So if you wanted to call that code uh across http wire, you that's what you would as a client.

B

A

Can have that and have that code running as a server somewhere.

B

Okay, oh yeah, and this is why, whenever we do yeah so okay, so then, somewhere in here when we initialize our clients, we must be reading this in right. In.

H

B

Local net client v1, where do we do it dial, is that it.

D

B

We something we must be using something in here where there must be something that new global client yeah.

A

B

Grpc client interface somebody's calling that yeah you have.

A

To be calling that somewhere.

B

Who's calling okay api to store, so here's where we do that, and then we send it this connection right that the connection j.dial was dial dialogue.

A

Yeah, okay, but all this stuff is prepared for you. All you have to do is write the code.

C

To make it have to call it, but where do we give it the ip address? I guess it's options here.

A

Yes, I don't remember, you have to create a the connection or dial do do it for you.

B

Well, we call dial and we send dial a connection.

A

I don't remember if you go back to the to my repository, I might do that, but I don't remember. I think I think.

A

But yeah it's it's! It's! When you're building the connection, you have to tell it what your uh what the ip is and stuff like that.

B

Yeah yeah somebody's telling it the ip address somewhere right. I don't know where, though I this, I keep thinking, it's got to be hidden in the ctx, but you're telling me that's a go.

C

Usually, it's not.

B

Okay, that's not it yeah.

C

You wouldn't be, you wouldn't do that.

A

B

Somewhere somewhere in here, there's an ip address, yeah.

A

Okay and oh, if you go back right to that file, you're just at you'll, see where it's being called.

A

I just saw that you're.

B

A

Well, no I'm saying like where the watch is being called after. They build a client, they were calling the watch, but it was this target.

A

I don't know what that is.

D

It's somewhere in here.

B

Yeah but I mean we're we're almost out of time, so um yeah yeah.

B

Where is it, why are we in the back ends? I mean oh, this is the worst, of course, we're not going to find it in the. If we look for ip there's going to be a million other references to ipl.

A

B

I, like dial, that was better right, so you had an idea right so so.

G

There is this flag here on why to pass the remote apa server. That's it.

H

Oh there you go.

B

So yeah we're binding that to server so watch has a server, but watch is a type that's generated right, I mean yeah, so watch is generated, so so it's in the buff protobuf then so is there a server in here yeah.

A

B

Okay, there, it is yeah.

A

You generate both a client and a server, so the.

B

Server is a protobuf thing, got it okay, so there's a grpc server thing and then that server is a variable that you populate and you and and then that server value this watch wait hold on this watch struck, though this server is corresponding to type of string. Just go back there on line.

G

31 you pass double server on.

B

G

B

G

B

Watch so it's an argument to dial.

A

Right, it's just the address most likely. Okay, so you.

B

Have to bring yeah okay, so it's an art, it's a function. So so, when you do grpc dot dial, ultimately, that's the um the way that you trick. What you do you trigger it: okay, cool yeah.

A

And this expects that some other process started your grpc service somewhere.

D

From the server address into.

B

The dial function, so the ops probably is where you put all your security stuff. So there's a dial option and maybe there's like a tls thing in there or something.

F

B

Right, so if I look for dial option, there's a prpc.dial option: this is inside the grpc library itself right right.

A

But usually that's how you uh configure the connection to tell it how you wanna, how you wanna construct the connection and, if you're, using tls, um if you're using any kind of authentication, that's how you would do it. But.

B

Where is dial option defined, though I don't see it.

A

Well, a dial option is the definition came with the grpc generated code, so it says.

B

It says it's grpc: it's got google.go line, dot right.

A

That's where it came.

C

From that you said, you don't see where it came from, that's where it came from yeah, but where's, the type. If I google, for the type, I don't see it type.

B

Shouldn't I be able to see it and grip that app.

A

Right, you should be able what, if you press, f12.

B

Here I got it okay file option here. It is.

A

See all this stuff, you just yeah that that's all the stuff you can set right there. Okay,.

E

Yeah there it is all right, cool.

B

Okay, um all right so I'll add this to the hack md and then vlad. We definitely owe you one. Today, you saved you saved our butts okay, this was going to be the worst andrea live ever and you know it's, I think, we're somewhere in the top five.

C

B

C

Top five shows thank you.

B

What are you doing.

A

What are you doing, what.

B

Do you think I mean where, where where does this go? Is it oh, then,.

G

We have a lot of viewers that are super good, also.

B

You're demoting it to a top ten. I was saying top five.

B

That's not very nice, I mean.

G

A

Why are you giving him a hard time, man.

G

All right, that's jay,.

F

That's what he does best yeah.

B

All right top five, let's, okay, let's put the difference. This isn't the top 7.5 shows ever I'll. Take it congratulations.

B

This is really cool man seriously, thanks, okay, awesome, so andrea live may the 25th. If you like, want vlad to do another show then just let him know tell him you want him to come back and do another. Andrea live show last, sometimes he's just too busy to play with us, but um let us.

A

B

If you miss him, if.

A

You want to talk more about grpc. Let me know, oh.

E

A

Put a, I put a link in private chat.

E

A

About another medium uh article, I wrote oh cool.

B

Efficient iot whoa. What is this, what are you doing? Would you buy a raspberry pi and do all this.

A

A esp what eight six six- and this shows you how you can have different plugins for the compile for the grpc compiler. This one generates small. I forgot what it's called it's like called small c or something like that, but anyway yeah. So if you want to kind of give that.

B

How did you get into this.

A

I was looking to do something completely different uh with uh to send to send data. Actually, I think this is what I did my presentation on at gun. I believe.

B

Why'd you pick this esp8266. How did I.

A

Want to pick something what.

B

F

B

Anybody even know what that is.

A

It's one of the most popular microcontrollers out there or control microcontroller platform. um It's from uh expressive.

B

What are you trying to build like? Okay,.

A

Well, this is, this could be like a little iot device. That's collecting that's exactly what it is actually are. You like.

B

Building little robots in your bank are you like anakin skywalker, like building your own little.

A

Robots they follow you around. When you make a mess on the floor, somebody got to clean it, so you build a robot.

B

Okay, so you're building, robots, personal robots.

D

Oh man, okay, flat's, building, robots. Now that was uh that was.

B

And you got what is this like a breadboard.

D

A

B

Oh, that's: cool, yeah! Okay! So, if folks want to watch this, this would be a really. This would be a kind of.

A

Oh yeah, there you go, oh no, that's just uh did I never put. I never put the link to it. Okay, but it's it's it's in it's on youtube, somewhere, yeah.

B

We can find it, we can find it okay, so maybe you could walk us through that one of these days, yeah, yeah, okay! Well, you know you're always welcome.

A

B

Guys that was good yeah all right thanks.

F

Yeah thanks everyone all.

B

Right thanks everybody for coming all right.