DFFML Rolling Alice: Engineering Logs: Volume 1: Coach Alice, 28 Jul 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Coach Alice: Volume 1: Part 41: Preliminary Input to System Context Creation

Description

https://github.com/intel/dffml/discussions/1406#discussioncomment-3266248
https://github.com/intel/dffml/discussions/1406#discussioncomment-3268573

A

All right are you with me with me all right, so I'm doing something I shouldn't be doing again, which is I'm trying to.

A

Try to replicate the version.

B

So what is this version.

A

Okay yeah, so let's grab this.

A

A

Okay, so reporting version, so we go in here and we import everything so we're already imported. So we wanted to say 32 repo, so.

A

Okay, so if module name got into expression,.

A

Else: okay, so if you imported it, okay, so basically.

B

A

Margining, okay, so it's modules there. If it ends with that version, then we imported it. Okay,.

B

And we did get hash pass. Okay,.

A

So what if we just.

A

Did what we just said.

A

Parents too, so this repo or this file is I'll cli, so alice would be parents one, so parents two would be alice entities alice, which is where they get or where the package.

B

Resides git hash.

B

A

Okay, so we can actually just pass it this file, so basically, this thing.

A

Okay, so short hash.

B

A

Okay, now I'm not gonna deal with this right now.

A

A

B

Okay: let's go split out this stuff.

A

A

A lot of random files in there okay, so this is what we're dealing with here. So this is the mess that we have created for ourselves, um so grab.

A

So here's all the files we have to deal with so.

A

Let's take a look.

A

Okay, so there's the main package. Okay, these are all directories. Okay, so here's how? Let's get I'm doing myself? That's where everything is okay,.

B

A

This is the okay, so we need to just throw all this stuff back in the same file now.

A

Okay, so this doesn't go in the same file.

A

I'll skip repo.

A

Okay, create branch, it cannot exist, okay, so this create branch of net exist, so clone gate. Repo should be separate, so this needs to be separated out so because the create branch of that exists- oh no, okay, so that is yeah we're not really using that anymore um because yeah, it's not really working. What was it? It wasn't really working for some reason. So that's why we switched the tutorial to just do with it.

A

A

Do everything all right, okay, come on.

B

Okay, all right: okay, come on okay, so.

B

B

A

All right that was the fire alarm. It's just going off at me. It's gonna freak me out again, probably.

A

A

All right, let's just do this! Okay, come on come on, come on, come on! Come on! Okay, come on all right, okay, burned out! Okay, um let's go! Let's go.

B

Let's go, let's go, let's go okay,.

A

Okay, create branch: if not exist, guess repo string is url, okay, so one of these okay. So this is separate. Let's mark this separate here, boop now it's separate okay. So what's the difference between these two right? Okay, so this one here so set, and u all right so 22 through 55.

A

What we're doing here is we're basically downloading. So so we're saying hey, you know, uh basically, our alice flow, our our entry point to our alice flow. Okay, where is our engine.

A

House alice, it's the only thing I say lately: okay, um it's better than data flow. It used to be every other word on my mouth. Is data flow? So at least it's now? It's a house so great, I'm stoked. Okay,.

C

A

All right, okay, come on focus all right.

A

What are we doing here?

A

Okay, guess: repo string? Okay, there we go okay, no, it's not here anymore. Is it here.

A

This is why it's in.

C

A

It's class, it's everything's, so confusing. Now, okay, so we just import df. Oh, we do df, not cli command. That's right! Okay! Thank god! We did that. Okay, um please contribute recommend community standards, cli, okay! So now this thing so because where's the base flow, I think that's what we need to start with here.

A

ah All right here, it is right since naming convention says this, is space flow okay. So, uh let's get rid of all this. This is just that's. That's that's bad! Okay! So um we don't need that anymore. um Okay, we don't need that anymore.

B

A

Contact's new audio popular configurable upstream, we don't need that anymore. Okay, uh security! How about is this yeah? um Okay, so this was. Why was this here? I thought I was really funny. Okay, so now I have to pay for it. So, okay! So how about? Is this? Okay? So not? Why am I saying this? Okay, it's in the video um all right, fine, we'll leave it past, john okay, um I'm pretty sure I always had a dumb reason: okay, um but we'll find out or we won't or whoever watched the video alice will.

A

Okay so run. The system of context for read me context is on a given is given on cli. Okay, so create okay, so run this system context where readme context is given on cli or overwritten via disabling of static overlay and application of overlay to generate context dynamically.

A

Oh so this is just saying: let's use the dash inputs flag and test that that works. Okay,.

A

A

And then we'll get rid of this okay, so, okay, that's not how we're doing that anymore! Okay is it! I don't think that's how we're doing all right. We're gonna do that overlay.

A

Yeah, I think we're not doing that right now. Okay, so.

A

Oh yeah, we need the auto dip. We need that auto discovery of the entry points. That's right um to update the enterprise txt, okay, yeah. We need to enable that okay, so that's been in the issue tracker for a long time.

A

So what are we doing here? We're cleaning up? We cleaned it. Oh, my god.

A

A

The to-do's all right- and this is the base flow and this thing takes alice gear repo. So basically, this thing doesn't do anything unless it gets an lsd, repo, okay, so well, it takes a. It also has this repo string, so what is using the repo string when it's a big grab, repo string.

D

A

Okay, here it is okay, so strong.

B

A

So here in the cli, we see reposting okay, so this is where we do our little trick. This was a good trick. I gotta say I came back to this today and wondering what happened here and I was I was like. I can't believe we figured this one out. Okay, um but now we get to use it again. So what we're going to do here is.

A

D

A

Do the same thing here right and remember what we did was we were able to reuse the same flow and then re-scope things with the new input set context right. That's where you get when you do a new flow. You get a new, you get fresh contacts all over the place and that's what we realized as we get all this stuff for free, basically so um well for free, because we already implemented it so um the isolation that is okay. So this is the typecast, so it is oh yeah so we're.

A

Basically, this is a because run. Custom is not as fully featured as we want. We just attack this together, so we're going to use the same thing.

A

um So unfortunately, I don't know how to program linearly, so I'm just gonna start doing what I usually do, because, unfortunately I can't I'm having trouble so um so we're gonna grab this I'm just gonna, I'm just gonna, let it I'm just going to let it do its thing. No, I'm not what just.

B

Happened so, okay, let's go.

A

Okay, so this probably needs to go.

A

A

Okay, publish for a second okay, so this probably needs to go in here and say. Why am I saying this? Okay? So, oh really, first is good. Now, okay, I don't think it does. Okay, so yeah. So it's not here so this is, please contribute, okay, so.

B

A

Control recommended communications, overlay operations, kit.

A

Maybe all of these should just be in the same file like they were. It was a lot more straightforward. Then.

A

And then they wouldn't have such long class names.

A

Okay- let's not, let's not do that; let's not get too crazy okay, so this is in the right place.

B

What's up with that.

A

Oh because I rename this okay so.

A

We're gonna call this overlay.

A

Okay, now it understands okay, so.

A

Every time I sit down and get tired, this is why I was standing okay.

A

Okay, come on. Oh, this is like not that complicated all right come on it shouldn't be that complicated all we're doing is doing a different version of what we already did. You know hopefully less complicated way, so this should be.

A

So what are we going to do.

A

I don't want to go, get an energy drink. I don't want to do that.

A

No that's a bad idea.

A

B

A

A

So for a little mint, okay, so.

A

C

C

C

A

All right so here we are.

A

Okay, there's not that many files here, okay, so.

A

Permissions check, support post issue all right, let's put them all in the same file.

A

A

All right house, please.

A

A

Okay, so let's see it we're going to t append all this stuff from all these alice recommend community standards alice because we are, I arbitrarily stabilize separated them yeah. I think we arbitrarily separately, separated them sort of.

A

I mean I think there was some reasoning behind it, but I think that it needs to change now, so um we're going to put it all in one place, so it's all obvious and then we're going to split it up we're going to try re-splitting it up from there supporting contributing standards and then we'll refactor it again all right. Let's go.

B

A

All right, so I think we got everything so.

A

A

So we'll pull all the imports to the top, remove any that are.

A

Duplicates or internal.

A

Or run the auto format.

C

B

A

Whoa, I just noticed you can see the reflection of the there's, my desktop as glass, and you can see the reflection of it. That's!

A

Okay! That's really cool! Okay!.

A

All right, I know somehow added this.

B

A

Remove unused imports.

A

Okay, this is what we want.

A

And we want to pass this file.

A

And before we do that, though, we're going to make sure that we save whatever we just did in this file by doing data.

A

A

See look at that right. Look at all those unused inputs.

C

A

D

A

Know what to do with typing, though, are you sure about that.

A

I think I see a lot of duplicate imports in here.

A

A

A

Okay, it removes unused, not duplicates. That's the deal.

D

A

All right so we'll add that gear remote in there explicitly.

A

Okay, we really like text wrapping path like it looks like does this use nothing else seriously.

A

That's awesome.

A

We're doing a lot of command line stuff, that's fine! The rest of this means that means the rest of us is being handled transparently by the other things in the flow okay. So.

A

B

So here we are again right, so when we added everything back together so.

A

They have bones remote, okay, read me pr.

A

Right: okay, so now we're going to go through and we're going to refactor these or, let's see so we should make sure everything runs first right.

A

A

I gotta update the entry points so they're all the same. Now.

A

They're all unrecommended.

A

Except for the cli or yeah, except for the cli, which is in the cli file, okay, perfect and then we'll have the metastatic analysis, one as well.

A

Okay, so that's all in there now: okay.

A

So remember our little sort of wpy again.

A

So that should update those entry points there.

A

Okay, so now these have to be made to.

A

Okay, so what line is this 86?

A

Okay? And it's looking for the thing? That's below it? Okay, so let's just put it right below it.

A

And then we'll start to split these out into functions and then we'll have our nice little library and then we'll call the library functions from the classes, which are the data flows, which we add the types to okay.

A

A

Okay, so this thing needs to move down as well, so.

A

Yeah, because right so we had them in a certain import order, and now we don't so what was it.

A

Okay, so let's find out where that overlay kit is.

A

All right, so it's down here, so this thing needs to go okay, so this thing needs to go below this standard overlay gate. So this is probably something that needs to go towards the top.

B

Okay, so 208, so we see.

A

That there's no good health issue yet okay, so this needs to go about this.

A

Okay, this is that give revo check over like it. So this turns the gear repo into the alaska repo okay. So now we should be at the same spot. Okay,.

C

A

Okay, so let's add those.

A

A

A

All right so we'll put it all back in one file sas. Please contribute recommended community standards. Okay, so put all put all overlays back in one file, okay, so going to extend to contributing uh contribution.

A

Via a sub flow.

A

And to lock it repo between branch.

A

Creations, okay, related and then we'll put the link to our minutes here.

C

A

All right so now, let's get in here and start hacking slashing.

A

Contribute bmd.

B

A

A

Okay, so yeah, so what was this? I think there was also an issue where it's like. Okay, how do we know if it's so create file, if not present,.

A

A

So, let's separate this into readme.

A

A

A

A

C

C

B

A

Let's repo get repo to alice repo.

A

Alright, so if it's a directory.

A

All right, so this.

C

A

Operations get okay, and so with that should probably be the this stuff here. This should probably be the same thing.

A

You script the strings url. Let's get your uh no branch type given okay url type, so if there is a url so if it finds a url okay, so if it finds urls these first three functions basically say: okay, look for urls!

A

If you find a url, it looks like you get repo, um then go ahead and clone it, and if you do right, so that's what this says: url type. So if you find a url, if you find a url, if you think.

A

You have a url to a git repo convert it, so it will be found okay and then here, if ak repo was planned, convert it to an alice repo alaska rebound, so that alice knows be dealing with it.

A

Okay, okay, so great branch does not exist. I think this is one of those where we'll probably yeah okay, so this one stays in here. Okay, so.

A

Okay, so this is missing a definition from something.

A

Okay, it's missing a definition of, or let's see,.

A

A

Okay, so this is the okay, so.

B

We got rid of something, so we got rid of what was it operations good.

A

So I got rid of the wrong thing: okay, so let's keep hacking. Okay, so community change overlay get determined based branch. Okay.

A

I think this should be its own thing as well or, let's see.

A

Determine base branch, okay, yeah, so.

A

Yeah, so I think this should be under here as well.

A

So we create the branch base branch if it doesn't exist. Otherwise we determine the base branch, given that the branch that is um given so okay so read me: branch remake my message: okay, so this looks like it's just read me based stuff, so contribute readmemd, so this contributes freebmd to the git repo.

A

A

Contribute readmemd, git, repo, okay, so I think we're going to call it yeah so we'll call this contribute. Md2, repo.

A

And then it'll say this is overlay. Read me okay, so.

B

B

A

So operations get over. There read me.

A

Okay, so this has to do with the meta issue, so we're gonna put that comment on meta issue creation.

A

Okay, so this looks like some more read me stuff, so read me current message.

A

Yeah so let's put that with the rest of the readme stuff.

A

So that's now meta issue: github launch remote, okay. So that's its own thing. This is the good stuff, and then this is the readme.

A

A

Okay ready issue and then midday issues, but I need to be at the bottom. Okay.

D

A

Actually, you know, I think, we're actually going to drop the meadow issue for right now.

A

I think we just won't enable the overlay for now.

A

I really read me over the meta issue.

C

A

B

Okay, so we have overlay meta issue.

A

Overlay readme.

A

A

Okay, so recommend community standards.

A

C

A

A

Okay, so this is maybe overly github.

A

A

A

So please comment, contribute, recommend, so guest repo string is directory. Okay, so a let's get ready. Okay. So if we have this alaska repo, then all of a sudden, the rest of these overlays are going to start doing things and.

A

What they're going to start doing is, if you have the git overlay or the overlay, get enabled, then it will try to create an alice, get repo out of a you know, out of a url if it thinks it can clone the url right, then if you do that, so determine default right.

A

So does anybody else output base branch, okay, so default branch get branch type? Okay, so this makes this sort of necessary well. This is necessary for any git contributions right. So if you're going to do git stuff, then you have to have this enabled okay, so that makes sense so, um okay! So now, if you have this okay, so writer will give room of origin.

A

Okay, I think this is kind of a get thing over like it right so writable.

A

Okay, remote origin: okay, so where does okay so readme pr? Readme pr needs writeablegate, remote, okay, so this so readme pr needs writable, git, remote, origin, okay, so, okay, so readme pr needs writable government origin.

A

So if we output it from github right, okay, so overlay github, alright, so readme overlay readme. So if overlay readme is enabled to overlay, readme contribute readmemd.

A

Overlay readme.

A

Overlay github.

A

All right so because we want to be readme centric. Now we want to be file centric conveyor.

A

You know we're we're trying to think about encapsulating this, because it's going to need its own lock right, so that also repo is going to need to be locked.

B

A

And it's going to need to be more specific right, so we're going to need to have a mouse um if they read me, so we're going to need to have something which is.

A

Contribute me get repo.

A

Okay- and this thing.

A

Okay, so contribute read me, give me vote equals housekeep repo.

B

A

And well, you know what to do with that.

A

I don't know if it's going to know the difference.

A

Okay, so I'm not sure the orchestrator will know what to do so. I'm just gonna do the same thing here that we were doing before. So it was configured.

A

A

Okay, so now, let's repo contribute.

A

Maybe just read me: the repo.

B

A

A

I was contributing that's the type conversion all right so.

A

Okay, so this takes alaska repo.

B

And produces readme repo.

A

That means okay, so we need to block the whole bit so.

A

We need to run this in the subflow right.

A

We need to lock the little bit.

A

What is the cli doing.

B

A

This thing, so, let's see what this thing is.

A

Okay, so cli run on repo. So let's get rid of that comment.

A

A

Okay, so it takes an alaska river. So previously we took a cli run on repo.

A

Right, so that was our scope. So now we're going to take this alaska, repo and.

A

We're going to say.

A

A

Okay, so we're going to say readme repo.

A

A

A

So we will okay so run custom.

A

A

And custom ctx, okay, so we're creating an instance of this run: custom operation, implementation and then we're executing it and we're saying repo is repo. Okay, and that means it's going to convert to this readme, give repo and run the subflow, and when it does that it'll kick in here and all these alice, repos alaska, refuse become read me, get reposed.

A

Okay, so now they're all read me: get repos, okay, so.

A

Okay, give me an issue: okay,.

A

A

All right body.

A

We're gonna appear body: okay,.

A

A

Okay, so this is over, they get.

A

B

And there's your body meditation title: ask a repo, okay.

A

So these need to be changed or not. This is yeah okay, so this is alasdair repo right, because these don't need to operate on a specific context, rights to create media issues of mediation body. So if you have a medicine body, you can go ahead, yeah and create an issue. Okay, that looks good all right. So basically, if you have yeah, so if you did the overlay readme, then you're gonna have a readme path and you can do that.

A

Okay and then you can break the issue.

A

A

A

A

Issue during the apr title.

A

Okay, I'm sure you read.

A

Okay, we make content okay.

A

B

Okay, I could not determine primitive of.

B

A

Lost reading the issue body somewhere.

A

Read me issue body read me as your title.

C

A

Just looks like we lost it somehow.

B

Okay, so we got some it's just a new error, great okay,.

A

So what do we got so invalid run. Custom data flow context. Okay,.

A

Invalid custom run data flow context.

A

Oh because the.

A

Oh because it's using it as the context.

A

Okay, so we're making everybody oh yeah, because it's only programmed right now to use the string inputs that context, okay, so the so. What about the.

A

A

A

Okay, so let's see what we did to this file here.

A

Please contribute recommended community standards.

B

A

So here are our classes.

A

Here's our entry points txt, so overlay gate, overlay github wherever they read me over the meta issue or they get get a readme right of meta issue and then community standards and then the clies okay. So.

A

Okay run custom; okay, so if.

A

Definition, primitive, not, and so let's make this alif and let's say, if self dot parent that can be big dot.

A

And they config so let's take an optional config parameter of.

A

Customer run data flow context.

A

A

Okay, so we need a plug-in type types space.

A

Okay, so we need a plug-in type base parameter, set definition that context inputs are config race; input, set, string up and set contacts; okay, so these need to be plugins. Okay, these need to be plugins.

A

A

Okay, but this is the system contact, so yes, this needs to be plugins. Okay,.

B

A

A

String input side, contacts; okay, so s add okay,.

B

A

Okay, so this is also that auto conversion, okay.

A

So maybe if we have a config dict, we can automatically convert like if the key now what case you couldn't have a complete dictator key, but you could have a tuple as the config deck, okay yeah, you could have a list of tuples or a couple of tuples. Okay. So.

A

A

C

What if we made it in entry.

A

A

Now we can entry point download, it.

A

A

Okay, input set context.

A

C

A

Okay, ctx definition; okay, so.

A

Okay, so so flow input, so we need to create subflow inputs as.

A

There is a record set contact somewhere.

A

Record contacts.

A

Record input set context, okay, so yeah, so we can pass.

A

So we can create okay.

B

Record input set context: okay,.

A

A

So subflow inputs.

A

Inputs context, input name.

A

All right, so this is the value the value goes. There.

A

Okay, so this should be the same as.

A

A

Okay, so what did we do here? Input set context class, okay. So oh, let's make that default to none.

A

Okay, so then we basically we create our subflow inputs using that class and then later we'll add to them. Okay, great so.

A

A

Run the subfloors.

A

Okay, what is it called? Input set context.

A

Webflow input context.

C

A

And then sit down here now we can say.

A

Upload input set context.

A

So flow inputs and then right here we can say input, set context.

A

C

With our inputs, okay,.

A

B

A

We're going to create the context great if it's not none, so if it is none, then we bail otherwise right so and then, if there is no primitive, then we're going to bail otherwise we're going to create it. That's going to be the input side context! Okay, so let's just go and confirm: that's the only place. That's used inputs inputs, input, name inputs.

A

Okay, that looks good to me.

A

A

Okay, so base config attribute, has now.

A

Okay, wait a minute.

A

Okay, so it's complaining that we're instantiating with base config, which means that we must be in.

A

We must be.

A

Okay, so we're instantiating with base config and what is it that we're instantiated, so that means the config object, didn't get passed correctly right, so we went to run this run. Custom.

A

Right and something happened where it didn't like the config right, so it said, run dataflow.config dot, dataflow equals okay. So.

A

Let's break and let's see what's the config here.

A

Still I run on repo.

A

Oh, it's there now.

A

Okay, so what is this.

A

Base config, so why is it base config?

A

Oh because cell doesn't have that config, okay,.

A

Oh because it's saying whatever the config of this is so cli run on repo, so this thing got base config, so it's default. Config really should be okay, so self.hand.config custom data flow.

A

Okay, so maybe we should just be saying: data flow.

C

A

Right because we're passing the wrong thing here,.

A

A

And it missing one required just wanted to make config.

A

Okay, so class.

A

So what does the class not take.

A

Soccer penta class but big.

A

Self.Parent.Class.

A

It's custom run dataflow, okay, so we're creating a new instance of ourself. So don't do that.

A

A

There we go okay, all right, so we were trying to create an instance of ourselves uh of this class cli run on repo, which is an auto death operation right. So that's not going to help us at all. So.

A

Okay, so now we can come here and we can define our custom.

A

A

Which is of type.

B

Which is of type the repo okay, so, let's see so, let's see.

C

A

So input set contacts; okay, so string input set context.

A

Record input set context: okay, and this is repo okay,.

B

A

Okay, so as string, we follow that url.

A

D

A

B

A

A

All right so now here now that we have this now we can say.

A

Input set context, class equals ascii repo and then it can complain about. So we don't have.

A

A

So now we have okay, so 204, so here it puts a context class. So it's mad about so convert value, type class. Okay! So for try to create this thing: ah okay, so yeah! So when we go through when we traverse through the creation of a class, it tries to double check the type information right. So it looks like basically it says it tries to reconvert it to the same class.

C

B

Okay, let's see.

A

A

B

Let's go check this out so basically, so let's go look in base.

A

248, okay, so.

A

All right, so here we are on line 248. We attempt to convert okay. So if is instance, so the value is not dictated so it tries to get if annotation is not none. Okay, so it checks the types.

A

C

A

Possible test? Okay, so I wonder if this is part of the problem here, so this should actually be.

A

It's actually tight or actually no, so this is actually a good opportunity for us to go and just do this. The way it's supposed to be done, which is.

A

Okay, so the way this is, are we still on.

A

So the way this is supposed to be done is.

A

We should have yeah so config config loadable.

A

Okay, now, let's set it okay, so if not dot load. Okay, so.

B

If you see the dot load.

A

Okay, then type in class.

A

Okay, so basically.

A

If this thing is a entry point loadable on 196, we see that this thing is an point notable then typing type class of type class. Then we come in here. So value is not okay, so we're coming here and then, if convert okay.

A

Okay, so this is where we go through and try to convert. So if we.

A

A

Run custom that it's going to take this base object.

A

I wonder if we just throw the.

A

A

This entry point.

A

B

Okay, so now, let's see what it is: okay, so.

C

C

A

A

Okay, so arg to.

B

The classroom data flow config and type class.

A

Value is atmospheric, it's a context. So this is the value: okay, so type class, if not dot, load in type class, so dot load and type class that corresponds with up here. We would do okay, so if our type dot load.

A

Okay. So that's because this is not a basic facilitator object.

A

So anything, that's a base. Data flow facilitator object. It's also an entry point.

A

This between loadable and has the dot load okay, so base configurable metaclass is not.

A

C

B

A

B

A

All right, so it's calling dot load on it.

A

Okay, so if learning.

A

If inspect, that is instance, loading return or is fast loading, and this.

C

Is subclass voting fast and printing loading.

C

Shop from inspect is not anybody.

A

Okay, so requires complete config off property or implications.

A

All right we're just going to make it an entry point, so it doesn't have that config thing so, okay, so that looks like a typo.

A

Okay, so something happened, but it doesn't look like it hit the same error, so that's concerning, so it should be hitting that error on the branch.

A

Okay, instantiating operation, implementation.

A

A

Kick starting context from child flow.

A

Okay, so I think part of our problem here is that.

A

We're only adding the gear repo and now there's like other things that are needed, so we should be adding all of the rest of the inputs. So we want that input set context to be isolated, but at the same time we also need it to have certain things that were generated beforehand.

A

So, let's just see, if we can add everything so.

C

A

I'm going to run custom okay, so we want some kind of like copy on right input set context.

A

So yeah, so we want to reuse it.

A

Now we're gonna give it oh okay, so we want to reuse the input type context.

A

All right, so the input network now not the input, it's the network that we want to reuse copy on right. So.

A

Oh god, I've done it again.

B

Okay, the memory input network context.

A

So we want to use this copy on the right. It has.

A

What does it do? C62 by origin, okay, definitions.

A

C

C

B

Your definition.

A

So if we wanted to copy one of these, how would we do it.

B

B

A

So if we want to have a memory input network context that does a copy on write over another input network context, we had if we had a copy on right memory and put network context that could wrap any other context. What would it look like?

A

Add context, result? Okay, so it would take itself a input network context.

A

The other inputs.

C

B

B

A

Okay, so added definition, definitions, check, conditions, okay,.

A

So you would take two, you would take the one that you want to copy and write to, and then you would take the one that you want to.

A

Add to so that's add.

A

So what interface does this need to implement.

A

Okay, so anything where you add you just do to the one where you're looking at it and then for the will for gather inputs and check conditions.

A

Yeah for adding other inputs and check conditions. What would you do you have to do it across both array?

A

So from that perspective, it's not as transparent, so yeah, because you have that underlined by origin. Okay, so it's not trivial to do a copy on the right thing with this. So how could we could we just dump the entire context? Say: definitions.

A

Memory definition second fade.

A

Inputs definition.

A

Face definition set context.

A

A

Memory definitions, context based definition, set context: okay,.

A

How are we going to get all the.

A

All the definitions for the context out there so organized by context, handle string and then, by definition within that, okay, so didn't we have a way we have ctx.

C

Definition, definitions.

A

Okay, so definition.

B

Okay, so this is a definition set context, so, basically, okay, so.

A

So this grabs you all the inputs for a particular definition.

A

So this should be an optional parameter.

A

A

Dot definitions, so entry, dot, definitions, okay, so memory inputs.

A

By origin, predict definition input list; okay, so basically we want this definitions, object.

B

Into that definitions,.

B

Okay, yeah so entry definitions.

A

Okay, so four item and entry definitions here: okay, so, if definition is not none.

A

Okay, I think that solves our problem, so.

A

Okay, so what did we do here? So basically, we made this definition a default to none. So if we don't pass any definition to this thing, it's just going to give us all the definitions right so.

A

Yeah, okay, so that way we should be able to get every input within the context.

A

So, let's make sure we modify base two.

A

Let's definitely set contacts.

A

A

All right, that's a pretty minimal api change there. So I'm happy with that.

A

A

Okay, so we can do.

A

A

A

So now I'm glad we got output operations wrong at first, because we wouldn't have this so I'll, put definition so od inputs, okay, there we go okay,.

A

For bb, okay, so repo okay,.

C

A

Copy all inputs from.

C

B

B

Eventually, could.

A

C

A

Which I support acting.

C

A

A

Okay, so over the underlying epidemic. So basically um so and let's see so octx, okay, so.

A

Custom run data flow cell cell flow, tcga, octx, okay,.

C

A

A

B

Okay, custom.config.dataflow equals okay, so run.

A

Custom.Config.Seed equals.

A

A

A

Okay, so that's it. I said society.

A

B

A

Okay, so three didn't like this: so.

A

A

A

Oh so this should have been.

A

A

This looks like it's in an infinite loop. Okay, so that's no good! Okay! So.

A

It's in an infinite loop.

A

Okay, it's an infinite loop because it's going to trigger itself right, so we don't want any input which matches the input that we just got right. So.

A

Item isn't for item, in definition inputs if item.value is not repo.

A

Rocket that again, okay, so.

A

If item.definition.

A

Just not equal.

C

A

It's really easy to create infinite loops with this stuff. Okay, so.

A

Okay, so here we are seeing data flow with input set.

A

Nice contribute read me inputs, repo.

A

Okay, request back.

A

Okay, climb get repo.

A

Okay, so how did we get here? Okay, so we cloned the git repo, we determined the default branch and then we came in here and we said, contribute readme. Okay, we got the reblog all right. Okay and now we want to contribute to readme and we try to clone it again.

A

So why do we try to clone it again? So maybe we have the wrong definition on there. So read me: get repo.

A

B

A

String. Okay, so maybe maybe when we get to overlay readme.

A

So when we get to overlay readme, then.

A

We really want you to stay within overlay. Read me once you're here right, so get up once from.

C

A

Is almost its own flow in a way.

B

C

So this is almost.

A

Its own love in a way.

B

A

All right when in doubt, more statements.

B

A

A little bit lost at what's printing what.

B

A

Okay, nothing in the seed and then we dump the whole.

A

Bunch of definitions: now we've got alice gurubo and okay. So it's not. I don't that definition. Okay, so this thing not going as well as possible.

A

Okay, so it didn't find.

A

Okay, so keys will go out and get okay values.

A

Okay, so yeah, so I forgot, the definitions are in the values. Okay, and now we don't get okay. So now we filtered out alice, get repo.

A

All right so basically copy all the but don't copy the that's going to re-trigger everything right, so don't copy.

A

So maybe we really just want to remove some of the operations actually.

B

And data flow okay,.

A

So, let's see text config data file.

C

A

Okay, so how do we do this? So should it all be kept to here so overlay read me right, so overlay read me so.

A

If you've had overly readme, then you would have over the metadata metadata or the meta issue would overlay the readme overlay.

A

And so I think the question is: is the self-contained still so um do we have any interaction up here? um Create branch if none exists? Okay, so that's a thing or no that that happens on the download.

A

A

So what about base branch, though, where is that used because the base branch?

A

We have an interaction point there with overlay.

D

A

And determine base branch? Okay, so it needs that base branch.

A

So he needs that base branch.

A

B

B

Okay, so if we created a data flow out of overlay.

A

Readme and checked, if the definition was in it, then that tells us if we should forward it. So how do we do that.

B

A

A

Okay, so then we register the entry point there. So this is just you know temporary, so we do.

A

Okay, so to do uh modify this.

C

To have self for reference, okay, so.

A

Here's a class.

C

Airflow it's from if okay.

A

Classes to help.

A

So I don't know what we have to do here, but it needs to be cleaner right. So.

C

A

So this is the overlay readme dataflow right so.

A

B

A

They read me data flow and then we can remove.

C

All this, let's see.

A

All right so, basically now we can just say: hey, you know.

A

If it's in the seat? Okay! Well, that didn't work.

A

So what is this? What is this overlay reasoning? Data flow? It's not defined.

B

All right face.

A

A

250: okay, we're right here.

A

B

And over a list of items, okay, so.

A

Okay, so it has some definitions there, so that's good! So is this another value situation yet.

A

Okay, that looks more appropriate all right. So now it's basically going to say: okay, so definition I'll screw repo.

C

A

All right, so if it's for this overlay, but not to recall this operation, that we just called, please call us.

A

Right so writable remote origin and face branch; okay! Well that finished up too quickly.

A

Well, that seems perfect actually to me, so I'm wondering what's going on so.

A

Readme get repo okay, so you know what it is. Is.

C

Can't really get your phone okay, so.

A

Starting contacts get reposts back, receive your request back, received request back.

A

Travel flow starting context: it's not up. It's none excusing data flow with input set alice. Okay, let's read repo definition equals.

A

C

A

A

That seems like the wrong definition. Man.

A

A

Thank you. Okay,.

A

The data flow seed.

B

A

Okay, so it's not.

D

A

The readme give repo the way it should be.

A

A

B

B

B

A

All right, let's see, so what definition is it being added as.

A

Okay, so here we are.

A

Okay, so here we are we're at the breakpoint line: 203.

A

Okay, there are two or four.

A

A

Okay, so where did that definition value come from.

A

Now, let's control, this is like a really long, auto generated name. So what happened here.

A

A

What happened here? It's just a really long argument, the name: okay, so definition so where's definition come from so parents and that's input, name.

A

A

Let's take a look at this.

A

Okay and her inputs, okay, so inputs repo equals okay. So now, let's see.

B

Here: okay, so.

A

Okay, where's the data flow.

A

Okay, so that giant mess is not in this list right, so something's up.

A

Read me: give repo yeah, so read me get repos there, but this giant whatever the this. Is it's not so what's going on here so.

A

It's auto definite and it shouldn't be so.

A

So it's auto definite, probably because of this replace all right, so self, clearing off run, custom data flow dot.

A

Customer data flow so run data flow amp, customer data flow, so the op equals opt out, replace readme git repo okay. So maybe I hate what this is like. I said.

A

What okay, that's so dumb.

A

Okay, so we're at the second breakpoint so.

A

Let's check out the off again.

B

Okay, gh issue view.

A

All right, roommate files like this, so that means that got to read every bow.

A

Does that get it.

A

Okay, that doesn't get it all right. So there's a there's, a problem here.

A

A

A

All right, okay! So what do we got now.

A

There's a pr title me pr body.

B

All right, let's go, take a look at.

A

Mermaid see what's up.

A

Okay, so what's gone wrong.

A

B

Okay, so it would be nice if you could say maybe.

A

Yeah be nice if we could say.

A

I wonder if we said yes, if we just don't return anything we'll put the return cap on.

A

I think that cleans it up a little bit.

B

Here's the cla stuff sailor, room repo.

A

And I wonder if we can fill that stuff so do the same thing right, firstly, says.

C

A

Goes straight, but I'm not going to return.

C

And that first, I'm going to put outputs.

A

Oh okay, so this is yeah. This is done, so this should be.

A

A

C

A

So I run on repo.

A

Okay, so now what it's done is.

A

Okay, so I think the diagram probably looks prettier, but it's functionally more broken now.

A

A

Okay, that looks like it stacked more levels like it should be.

B

A

All right so cli is asking for okay, so we come in here we get the cli.

A

We look at the repo is string.

A

Guest robust ring means no good branch, given.

A

Okay, I don't know if that's doing raining, it doesn't seem to be hooked up to anything.

D

A

Why it's not there taking a good branch given.

B

A

Okay, so why isn't that being.

B

Why is this not being.

A

B

I think it's the flow.

B

B

A

So yeah, so why is that no gate branch given not there, I'm not sure, because it should be connected to this over here, I'm not sure. What's up there, um it looks like this check if your repository url is working so.

B

A

What else do we got.

A

Great branch, if none.

B

A

Okay, so here's this repo okay, so now we're seeing that the readme stuff is on the.

B

Bottom here, okay, great.

B

C

I just to be able to see better.

A

Basically, sub god's names are still long.

A

Oh, my god, look at that.

A

Oh my god. We can actually read it or a concept. Okay, um wow! Look at this! It's legible, okay,.

A

Okay, so we come in, we say repo okay, so we see this disconnection here.

A

It's weird, I always feel like the most clear headed around now, which is like whatever the in the morning.

A

B

All right back to it: okay,.

A

Yeah, it's a lot easier to read so.

A

Great branches exist, branch default branch and then you take the result and you say: hey, you know that contribution.

A

The readme is going to need that from a git perspective and the pr is going to need that this is looking great okay, so it doesn't work out sound and that's no, it doesn't do us any good, it doesn't work so.

A

C

A

And I just say: oh no, I asked add your name to the other one. So.

A

There we go so, which name so without further name the long names, the short name.

A

Look at the short names.

A

All right, great.

B

All right, okay,.

A

Let's keep packing okay, so.

A

Example, diagram, okay, so.

A

Okay, so the problems we have now, I'm pretty sure, are coming from the fact that, let's.

C

A

I'm pretty sure they're coming from.

A

Oh, the auto flow yeah okay. So it's not accepting from seed.

A

Oh, it's not accepting from seed, so we have to fake the origin, so we fake the origin. Oh, this is interesting.

A

So we fake the origin when we add the input into the subflow.

A

So that it still thinks it's coming from this operation because it is coming from this operation, it's just actually, this is actually doing it. It's sandbox effectively like so this operation is actually returning readme give repo, but it's it's not really returning recreated revo, it's forwarding it so from that perspective, so run custom.

A

A

How do you set that origin on something.

A

Okay, so new input, origin instance name key okay,.

A

A

So yeah, let's just forget this: we don't need any inputs.

A

Yeah so, as far as the same concerns, there's no inputs and no outputs.

A

Or well, it can't have no inputs.

A

Okay, so the origin is just the interesting part, so parents.

A

Okay, so are we actually we actually just take this input.

A

So we have this input, object.

A

The origin is us, so so.

A

Filter paint.output instance, name, okay and key- would be.

C

A

All right so basically give me the one value: that's gonna, be the outputs appearance.

A

A

A

Alright, so key okay, so.

A

All right so create the input, object all right, so definition definition and parents okay. So this is one of those where it's like honestly. Could we just have that input object please, um and then this would be a lot easier. So.

A

We don't have that right now and I shouldn't try to do that right now.

A

I know I want to it'll be quick; no, it won't be quick, don't do it. Okay,.

A

I guess we have to set parents to none.

A

A

A

So when this thing's called it should okay, fine.

D

A

Repo equals repo, okay.

A

A

Okay, so this should.

A

B

A

A

I didn't like that so.

A

Okay, so we're not to here yet so.

A

This is basically the exact same code.

B

B

B

A

So this thing does the repo string, but it's going to return it so.

A

It is also saying: hey repo string, okay, so.

A

And this one when it runs custom, it also says repo and repo is the same thing. Okay, so this looks like the same code, okay, so now so basically, yes, this looks like the same code. Only we want to do repo string, but we're going to get that from the definition.

A

So inputs is repo string.

A

Okay yeah, so whatever the output is okay,.

B

B

Okay, it works for me.

A

Operation has new attribute operation, parent dot, option, operation, dance and standard kit, 140.

A

A

Okay, so now we're screwing this up. Okay,.

C

A

And wait wait a minute. Where did that.

A

Anyway, have something a few seconds: okay,.

A

Okay, so and then this becomes whatever we're trying to typecast as.

B

Alright, so I'll put this replacer well, inputs is.

A

A

It's supposed to be like this, because I'm supposed to change.

A

A

Input ctx, employee.

B

A

And then down here, what do we do? We just.

A

So we loop over inputs, okay, so.

A

Drop that parent dot after inputs name.

A

If I don't okay, so.

C

Not is instance,.

C

Value in phase.

B

A

So now we basically added this thing that says: okay, if it's an input, just treat it as an input. So if so definition equals self parent of inputs, input name.

B

There's more tea: okay,.

A

I'm putting in okay so.

A

A

A

B

Whatever the definition is.

A

Okay, so now I type it through definition.

A

Okay, so now happy.

D

D

C

Okay, so we're on here.

D

C

Turn different.

A

Okay, so we came through excuse me so 1 31 132, so let's run custom here. So that's what we'll do for ctx.

B

A

What is custom run dataflow ctx.

A

Oh, I see okay, so.

A

C

A

Okay, I see what it's doing so it's complaining that.

A

A

A

Okay, so now we're going to do a special case for this, we do that value.

C

A

um I think we caused an infinite loop. Okay.

A

Okay, thomas.

C

B

A

What did we see here? What happened so we came in and.

A

So strange we're still streaming we're still streaming all right. Okay, youtube hasn't cut out on us, yet, okay, so.

B

Cli run on repo okay, so we hit that and then.

A

We jump in here we instantiate the data flow again. It says, cli has repos.

A

Cli is month on this repo.

A

Okay, so then cli run everybody okay, and then we have check about give repository url, okay. So the problem is that we're doing these cli things again. Okay, so.

A

So we want to okay cli run on repo, so we want to do something.

A

Similar to what was done here, where we basically say: don't don't do this.

B

A

B

A

A

So this says now do not add so.

A

This is used to ensure we don't add any inputs that would re-trigger this at any operations within in this overlay. When, on the subwell.

B

A

A

Okay, now our problem is over here, so.

A

I like the way this is coming together.

A

So now we have our translation. We talked about many a few weeks ago, so um entrepreneur object, has no dispute.

A

Okay, look at that, so we got somewhere this time we didn't. We didn't quite get our failure back that we want um that. That issue where so, basically, we made pure body okay. So, let's.

A

I think we mostly just did little internal things there, but let's see how it looks.

A

Okay, so did that get back connected up that no get branch given okay, so maybe that's part of what's going on.

A

A

B

B

Okay, read me issue. Read me, commit message. Read me pr.

A

Title so we get through to here but read me, commit messages into reading. Commit message is not there.

A

Message: okay,.

A

Contribute readmemd, so we have commit message. We have repo, we don't have base. So I think I think what we're missing is base off of this determined default branch. So I think there's no gate branch. Given it's our current issue, so.

A

A

A

A

I go through and do some commits here.

A

Sure name, one was good.

A

Okay, so uh for birding buzz red.

C

Shortening uh very short up mistakes.

A

Or slicing off.

A

Okay, what's next, okay,.

A

Okay, so these were nice, so this is git commit yeah.

A

Definition set context, make definition optional.

A

A

uh Yields all is not given.

C

A

This input network contacts okay, so we did a few things to run custom.

A

A

We'll do this utility, my personal command assignment, fill.

C

A

A

Class, if loading, if class, if entry point to load given, is loaded class.

A

And we'll say: use config.

C

B

B

A

All right, we're gonna, do this data for one first, let's make sense more okay, so coming out of some operation, data.

A

I'll run, custom.

A

Okay, um what did we do here?

A

We enabled explicit inputs and.

A

Alternate inputs that context.

C

A

Through passing, input objects and set it alive setting- and this is this edge of alternate of custom input.

A

Okay, so now we got the wrestles.

B

B

A

A

A

Far as contribution scenes, okay, so refactoring.

A

A

C

With each file.

A

Okay, so it's still they're currently broken, not asking.

A

A

So let's go figure out why that is.

B

Okay, come on come on.

B

C

C

A

All right, so we committed all the stuff okay. So now, let's go figure out. Why is that not going.

C

A

All right, so, let's look at the yam wall because I don't do well with json.

A

B

C

With all this question, mark situation.

A

By the denoted key that spans two lines um in the ammo, so this is ugly okay, so.

B

What are we looking for.

C

A

No good branch given.

A

Okay, now get branch given and then guest repo.

A

And so this one outputs a result of no good branch given.

A

So the first thing we should check is: is this thing actually running all right, so this guest roof is from.

A

A

Okay, so what do we got here so processing results? True,.

A

B

To go through this.

A

Okay: let's look for this gear: repo default branch.

B

Okay, so it does run that okay.

A

A

What about this.

A

So it does run that all right so then through reading here, because you've done that.

A

Okay, it doesn't run now. Okay, so control room apr. Has the base branch.

B

B

All right, I'm gonna, take a break.