Unimatrix Members Call, 12 Feb 2020

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Unimatrix members conference call 2020-02-12

Description

https://gitlab.com/unimatrix

A

So hello, this is frederick from axis and willie.

B

We have two new companies with us today and we have jenny, tech and ryan rosa from foss.

C

B

B

B

D

Hi, do you hear me.

E

Hello, hello, hello, hello, hey, sorry, I'm sebastian for genetech! um Thank you. Thank you for the welcomed me to this meeting um I'll today. I will be an observer more than a participant just to grasp the information. uh What we do and uh yeah so um yeah, it's gonna be fun. Okay,.

B

A

B

So today we plan to walk through the technical shelter from this year and after that we are going to talk a bit about the next hackathon in april. Anything else you would like to discuss during this webex.

B

As we fed a good start with through the shelter.

A

D

A

I started compiling a document with some goals and requirements for this year. What we, what we want to work on, so it's on a branch right now you should scroll up.

A

So it's in the private.

A

On the tv charter branch, if you want to have a look at it yourself after this- and you can also make your comments there on a separate branch, let me just go through the document, as it is right now, it's just a draft so far, but so the overall goals. It's those.

F

A

That we already have before it's the video api using opencv. It's the inference. Api that axis has proposed is to use.

A

The lara api with the tensorflow serving api on top.

A

And then during hackathon there was plenty of interest to do a capability api using grpc. So I want to include that for the goals and then also it was discussed to have an orchestration component like the cube edge.

A

In the in the goals for this year, are there.

B

A

Overall, on the on the overall.

A

A

So if there's no, um I think it's pretty ambitious goals anyway, so uh I think those six goals, uh the yeah. We have some generic requirements as well, so so uh these are also maybe not so uh controversial, so one generic requirement is that we should use existing apis where it makes sense and it's possible also. We want to use the cloud native computing principle, which is centered around doing microservices.

A

So for bulk data we want to have zero copy transfer portable and for for the for network apis. We we want to use uh efficient, binary transport like the grpc.

A

So uh so far we have discussed uh two two different languages at the hackathon. We were using a lot of python, but also, of course, the edge use cases, uh the c and c plus plus, I don't know if from I mean we have now genotec on board, which which languages you are. You want to use that.

E

Yeah we can, uh we can adapt to those we, our core business is based on net core, but um but we can definitely for embedded. We can. um We have also expertise in the c-plus plus. um You can.

A

Go in that path too, all right, so um the reference platform it was that used at the hackathon was the raspberry pi with the just the camera module. So, um but I I see we probably wanna have a reference cloud platform as well, so probably an amd64 uh architecture.

A

Could be added.

A

And then I added some requirements regarding the sdk packaging, so if they're all open for discussion, I just put some of my ideas here.

A

So the basic packaging of the sdk will be some container alone, and so we want to allow to do your own efficient backhands for hot.

A

Acceleration, basically that's how we do the packaging for opencv, so we have a base package container layer. We can see the uh base libraries and then we can have an axis back-end that supports our hardware so similar we discussed a little bit about this during the hackathon. How you can do your own back end to opencv for your specific hardware, so this this is something I want to continue to discuss on on the next face to face.

A

So also, I think, having one massive base layer doesn't make sense. So that's as much as possible, we should try to package different languages in different layer, container layers, like maybe c c, plus plus, since it's smaller as a base and then have you know if you want python an extra layer on top.

A

A

Also, we should start thinking about automation, so how to test, and so on so I mean we are using gitlab platform, so it allows you to do some automated uh continuous integration, continuous deployment uh stuff, which we should so we should start thinking about doing a test suite.

A

Anyway, so that's some generic requirements, just uh generic principles that I think makes sense. Are there any other things you'd like to anything you'd like to add right now or otherwise you can always. You know, make your comments in the git on.

F

A

E

In the devops part, maybe thinking about uh observability standards.

A

Yeah um any specific thing.

E

Like maybe some standard like stat d or uh like for for uh telemetry- and I don't know.

E

Foreign another standard.

E

I have to check, but uh just opening the discussion about observability we can build standards on that.

A

Yeah I mean so you're welcome to. If you have some specific uh idea, you can understand it over email on the reflector or you can add in the git.

A

Okay, all right so uh regarding the video api.

A

So we have already started some: uh it's it's not available on gitlab right now, but from axis side we have started some ideas here.

A

So would like to contribute this somehow, um I'm not sure if the the driver we have done makes sense to open source because it's very access specific. But you can certainly see some idea how you could do for your own hardware to connect into opencv with zero copy.

B

A

So I added some goals, some specific goals here for a I wanted what we want to look at during the year about the video api. Also, we should maybe start thinking about um hardware acceleration using opencv.

F

Yes, we'll be fine more how to use the gpu with opencv or view.

A

A

Yeah audio here is.

B

A

We discussed during the last hackathon I mean opencv is only video, so I think yeah. It definitely makes sense to think about an audio api.

B

Should we have an audio api on the girls as well for 2020.

A

At least some investigation around it, I think definitely yeah yeah. I can add that part I mean uh also, we discussed briefly at the hacked on uh we. We have looked at two different apis, so one is the pulse audio, which is kind of a standard api for linux and then.

F

A

Api that is called pipe wire, which is a bit more modern.

A

It's actually been chosen as the standard api for automotive linux.

A

Are we open for discussion there, so I think yeah we should maybe add a goal, for I mean to investigate all the api.

F

Yeah show that please look something.

C

A

A

And it's the inference api so.

A

G

A

We propose to have uh the uh api that was presented during the hackathon.

A

Which is a zero copy api um that a lot? That's the agnostic to what model you you use as long as you have a back end that supports that model.

A

We we think we need this kind of flexibility.

A

Because there are so many different deep learning, processors and gpu.

A

Different model formats that we have to be quite flexible now, even though, in the long term we might might want to report only a few more as it is today, at least I I see a lot of different models being.

A

Used so the the one we showed at the hackathon was basically.

A

Using t flight also, we have a support for openvino and we, I don't think it's in the source code in gitlab right now, but we'll add the support for google edge tpu model.

A

Okay, also, we have had initial discussion with ambarella ambarella cv25 cv22 should be possible, so we are in discussion with ambarella if they're willing to open source their parts so that it could be also put on the source in right now to even get their tool chain and so on. You need to sign nda and I'm not sure if they want to put everything but.

B

um Joining unimater yeah we will hopefully come to the next hackathon.

A

B

A

Hackathon will be in california, so.

D

No sorry oregon yeah.

A

So it's not so long travel for them to go. There.

A

So is there any feedback on the inference? Api are the requirements?

A

Is there any other requirements or vita.

F

Tech side: this was good. This was the annualistic to the model and it's fine.

A

Is equation online.

H

Yes, it's okay, okay,.

A

So I mean we also had a discussion during hackton about creating, because the current lara api is quite simple, so something more complex could be added on top.

A

So the proposal for this year is basically to have the lara the zero copy api for basically for edge use cases and then the tensorflow serving api. On top for doing the network, api.

A

Okay, so yeah go ahead.

B

A

Then the other parts are less.

A

Developed so regarding the deployment api so far, I suggest suggest you use just the container the grpc api to as say base api.

F

Okay, what is grpc.

A

Grpc is google's protobuf based network api. It's uh so you kind of encode everything into a protobuf, and then you you send it.

E

A

F

For this, for do inter communication.

A

Yes, even yeah internet communication, so I mean your colleague otavio was prototyping in the hackathon. He did the capabilities api or using here.

B

You have multiple language support for grpcs. You could import different languages from different containers. Okay,.

A

Yeah grpc is like, I guess, the modern way of doing an api. These days I mean, if you, if we take on with it's a soap, yeah all old style, and then we had between. We had json and now so now ever a lot of apis nowadays are on using the arps.

B

People are moving from json to the rpc and we're trying to go from here to your pc. Okay, you could describe the interface and generate code as you deal with soap and.

A

It's easy to use, since this is also a network api. We could. We could standardize this you know with. If there are enough companies that are interested in doing this, so we can. We could create api's, more modern apis in order for doing the stuff, we need.

F

Yes, will be nice getting rid of soap.

A

So here I haven't written down so much about capabilities guys, so um I've written down some use cases uh like query imaging capabilities, ptc.

A

A

So please, if you have other use cases, maybe we should actually we have a use case document. Maybe we should actually move the use cases we had from that document into this one. We have one common document, which is, uh I think, the old document ad is a word. uh I think it's more easy to if it's a text-based document to for people to read and comment, and so.

A

On someone willing to to do that, maybe dora can you? Can you check if the use case document can be kind of merged? With this.

H

A

Sorry, I you are.

H

B

H

B

Out a bit, we didn't get the what you.

H

D

B

A

Finally, for orchestration, um so I I want to if we're gonna use orchestration, I think q batch looks really good, but I don't want to have it as mandatory requirement for a device to because it's still quite big.

A

That's my basic idea.

F

Regarding the orchestration, um maybe can be interesting. Look how uh hustle to do these things. It's a no software to managed smart device in home like light and switch, and have also uh the ability to install components that are basically docker image and around this image and spawn stop managing the life cycle of the docker container.

E

A

Yeah, so I mean using docker is basically a simpler orchestration than kubernetes. I think so I would. I would rather go to the kubernetes side, because I see better scaling in the long term with the most I have.

B

And you have more developers going for kubernetes now, so the orchestration is killing kubernetes. I think yeah.

A

The whole world is going towards more like bananas, but it's still quite big, but I think it's a moving target. It's getting smaller like every release.

A

Okay, but yes,.

A

B

A

And I added some commons components that we could think about.

A

A

All right, so are there any other any comments, any other things you'd like to add.

I

I have one question: this is jacqueline, so duration, part coverage. My recognition is coverage. I have a container demo, so I think coverage or continuity is.

A

Mutually exclusive, but I think cuba lives on top of container d.

I

A

I

A

So I think in the next release, because right now I think they required- or at least they have docker support, but um at the hackathon we uh sean and kevin that they were saying they were gonna. Remove that part and then that's why they they could reduce the size of cube. uh They were thinking, it would be around 20 megabytes when they're done with that, but it does require container d. So it's it requires uh implementation of cri, the container runtime interface and that's what container d.

B

A

Okay, so um if there's no other comments about this, I I think I will merge this to master and then we can so dora. You can make your changes so try to include other use cases we had and then, if you have more stuff you can you want to add, you can just create a branch on master and.

A

A

Maybe we should um we kind of rearranged a little bit in the uh private.

A

We we have been looking at the governance so previously there was a document called governance in in word format. Now it transformed into two new documents, so one is called the governance board charter and then we created a new one called the technical board charter.

A

So um the the word document is basically this governance board charger. There's almost no difference. We added um genetic to the board, okay and other than that. There's no, not really any changes in the rule, so this is basically the document that was uh discussed and approved. I think so I think only there was comments from videotech and sonic. On that talk. I think uh pal has included all those comments. Can you that's correct? I have.

B

Taken this into consideration and changed text.

G

So if that means attack is fully uh agreed on our on our uh online online right.

A

Can you sorry.

G

I want to say that, uh can I say, gen tech is already fully agreed on our to uh uh to join in our our organization right.

B

Yeah yeah yeah correct.

G

B

And you'll have a governance board. uh Webex and uh hugo from unitec will join that later today, yeah there will.

A

Be one more telco for the governor's day right, yeah it's in three hours from.

E

Now ah yeah, that's fine! That's like that! Yeah.

A

That's why I sent the update out there yeah.

G

Yeah, I know that that's why the meeting I I have is different to doors. So, yes,.

B

We could mention here as well that we are in contact with linux foundation. We have the first webex team from linux foundation to guide us. They could have some discussion points for shorters.

G

Yeah well yeah great yeah, that's it okay! So next meeting you mean linux guy will join or.

A

We're not sure about it. Maybe um so what's gonna happen. Next is uh because we we first contacted uh cloud native foundation and I didn't think it was a good fit since there is mostly infrastructure, more individual products, not like a platform like we are trying to do so. Their idea is basically that it's more like a platform like similar to what automotive linux is doing.

A

This product would be more like a its own product under linux foundation. So we have contacted one person called michael dolan, so he would. We will have a and they're going to form some kind of uh group to kind of guide us into creating a linux foundation. Okay,.

B

We will give them the chart or somehow give us feedback if it's compatible. We need to change anything. We will.

A

Review it, we will put this charter in the public when we are done here. We will put this in a public uh project to.

F

A

The private to a public project so that we can communicate with elf more easily.

G

Do you know when we go to public with this idea.

B

It depends on the feedback from lf, uh so that will be a process for them to drop this project.

A

They thought I mean one opportunity would be june when there's an open source summit austin, but I think that could be a little bit uh too early because we wanted. If we want to do a talk or something at the event, uh we would have 10 million papers immediately and so on. So I think, maybe after summer maybe open source summit in europe could be a good.

A

A

Please have a look again, uh even though I think this document is pretty much reviewed and I we can move ahead and go in public with it.

G

Yeah sure we will yeah no problem.

A

And then we created a new document for the technical board, so I think last time a governance board decided to create a technical board. So we created a new document about that. uh It's a bit shorter, so it's uh and we have some.

A

The idea is that uh each company on the governance board, it happens, eat on the on the technical board. So we have the same companies. uh So I have I'm missing one, but I guess manuel you can be the person in the technical board from the attack side.

A

F

Ask octavio first, but I can be the the guy okay.

A

And from her way, wayside is, is anyone from hawaii's side.

C

I think so this is judy's here.

C

I see you have a fine future with let's shine.

C

I'm sure, okay, I think.

H

C

Think that's. Okay.

C

Should I put.

A

Your name, or can I put kevin's name.

C

uh You can pitch my name here.

F

A

So, since this is a new document, so please uh have a look at it and um but I don't think there is anything really controversial here, but before we go public you can you can at least give it a comment.

A

A

A

Okay, next topic, then, would be the hackathon in uh yeah.

A

B

A

Is to kind of host it? We don't know if there is going to be a registration fee.

B

Future way was initially going to to make the hosting, but they couldn't do it yeah we're stepping in to do it instead, but we are.

A

Getting planned.

B

Trying to find a hotel and so on, so we will send out information as soon as we I have um found.

F

B

A

Yes, so I would like some input from you guys how what the theme will be for the hackathon. My own idea would be kind of hybrid solutions, so it would be. You know I mean panasonic they you. You were really doing this last time, because we, you started off with an edge application that did mqtt.

A

Sent a result to mptt broker, and so those kind of applications where you have multiple use like it may be a cloud component, maybe an edge component and so on. So that because I think that really shows off uh how uni matrix is is different from ossa, which is centered around only edge.

B

And then we probably could have more companies doing the same demo, you're doing different components in this um yeah.

A

So if you have, I mean, if you have good ideas, so please contribute them. So we can plan, I think, before the hackathon. We should definitely have a good idea on what you want to work on so a little bit of preparation on what you want to do.

A

A

Do you already have some ideas? What about from genetech side.

E

Not yet, but uh definitely around the hybrid solution, uh mixing uh on-premise cloud and uh uh but nothing more around that we need to brainstorm. uh What what we're going to do there.

B

Maybe for the next uh webex, if we have it in two weeks time from now, we could prepare have a discussion on the theme.

A

Any ideas from hikvision.

H

Sorry, you mean prepare something for the hector activity.

A

Yeah, at least so have some ideas already now on. You would like to.

H

uh Yes, okay, the uh the first thing uh is about the runtime api, a standard api and uh the other. Maybe we will prepare the uh dfc uh we will attach to the performance of grpc and uh the rest api and give the result and maybe prepare some examples. Api examples.

A

Yeah you mean like comparing yeah.

H

Comparing the performance and the.

B

Presentation or something we do during the hackathon.

C

B

It is something you do before the hackathon and present yeah.

H

Before yeah before yeah.

B

That's good: um um you will be able to do a presentation comparing.

A

B

That's perfect: we could have that on my gender.

H

B

We are talking about the hackathon part where we collaborate and yeah. We need to have ideas about what to collaborate on during the hackathon.

H

Yeah, if maybe we will specify some apis and we can implement them during the hacktone and test the test.

A

And any ideas from.

A

A

E

A

I

I

B

Do you have any ideas.

A

So what do you think this hybrid solution as a theme.

A

Okay, please think about uh till the next webex. If, um if you want to do some uh have some specific ideas on what we should work.

A

A

I think that's all.

E

A

You have anything else, you'd like to bring up today anything from videotech.

B

I think the date for the next webex- I don't think we have no, uh we could set it for two weeks weeks from now the same time, that's okay with everyone.

F

Yeah for video tickets, fine.

H

Fishing is good.

D

Thanks, I'm here for genetics.

G

Tell me again about the schedule for the nexus hector where and what is that confirmed or.

A

It's not 100 percent confirmed, but we are finding so it will be seattle, and uh between april 21st and april 23rd.

G

uh So that'll be okay.

G

The country first choice should be u.s right.

F

B

Future way couldn't manage to host it, so we had to take care of the hosting and arrange the hackathon.

G

We don't know we don't know what will be next in april, but yeah. Currently, that should be a little bit difficult for us to go to us.

B

We don't have the development. uh I know there are a lot of restrictions right now, it's hard to predict what is going to happen, but isn't the same problem with camera yeah. I think it is.

G

No canada is fine because they are open to uh they don't make any limitation to uh for for chinese for chinese tourists the better u.s. No, we need to stay outside of china for two weeks. That is for sure. Currently, this is the current current regulation, but for canada, no, we don't have.

A

G

So that's why yeah? That's that's. Why last time think.

A

G

A

We could think about moving it down to vancouver.

G

Yeah, it's a, I think it's that should be much more better for chinese to chinese workers and if we can make that in canada- and we should have a lot of choice because we we have different locations over there and they can do they can do hosting as well. So, uh okay be much more choice. Yeah we can provide.

A

um What could hick uh host it in vancouver.

G

uh We have we have that we have a branch office in toronto and montreal vancouver. We plan to open our office, but I'm not sure that should be a big location or small. I'm not sure it's not confirmed right now, but toronto and the montreal we have very, very uh special location over there.

A

Yeah, I think it should be at a convention center or hotel, so not on uh hikvision premises.

B

We had a taxis, we hosted at the hotel, we think that's a good solution. uh Conference center.

B

Facebook and microsoft that would like to attend yeah the meeting.

A

So we want to kind of make it easier for the west coast companies to join so because we have some new ones that potentially want to join. Slo. We've been talking to microsoft and at facebook facebook initially wanted to actually to host the meeting, but they stepped down.

A

And then also we have umbrella, which is on the west coast, so we want to make it easier for them to join uh this event.

B

And many companies feel more comfortable uh going to a neutral location like a hotel and okay u.s companies. Have you now have restrictions as well? So it's a bit complicated.

A

Also, we want to attract avigilon as well. They also in vancouver based so that could be vancouver, can be a good option.

G

Okay, no problem yeah vancouver is a very very nice place to go yeah no problem for us, but yeah. I just want to.

A

I think I'm not sure, okay, we'll look into that part.

A

A

Anything anything else you'd like to bring.

G

Up my party is fine. It's good. Okay,.

B

I don't want to have anything to bring up. I have.

E

A question about the the shape of the acaton- maybe it stated I didn't I felt too. uh Maybe I missed it. uh Is it like? Do we unite as a team and do something or each company will bring his own team and work on a topic where you will assist on the accomplishment of the objective.

A

So last time it was a little bit of a mix, so we formed some teams on site which wanted to do kind of similar stuff, and some teams were already like formed before so. Panasonic worked together with axes on on some some things and and then so it was.

A

I think it would be good if we beforehand know which companies want to work on on like we can like form the teams beforehand.

B

And we formed it ad hoc. Can we mix um this time next time? We think it's better planning, even if the hackathon was successful. I think it was a very successful. Last.

A

Time it was good, but yeah. We probably need a little bit more preparations on exactly what each individual want to work on. That's coming.

B

So if the next webex we focus on getting the theme and the task we are going to do during the hackathon, we could deal with planning afterwards.

E

Okay, thanks clear: okay,.

B

Okay, if there is nothing else, I thank you all for attending.

B

Speak to you again in two weeks time.

D

Sure, okay, thank you very much. Thank you very.

D