DFFML Rolling Alice: Engineering Logs: Volume 1: Coach Alice, 16 Jun 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Coach Alice: Volume 1: Chapter 1: Part 10: Alice Should I Contribute GitHub Issue Creation

Description

https://github.com/intel/dffml/discussions/1369#discussioncomment-2959986

A

All right, it's working.

A

A

So what are we doing today.

B

A

Hello, hello, alright, great anyway, so we're doing this.

A

I don't know why this is so stressful, right now, okay, uh this should not be very stressful. Okay, um all right we're doing this, um and how are we doing it so? Basically, um okay! So let's go into.

A

Okay, let's see what committee are we on.

A

Okay, so this is the last commit okay yeah. I think I pushed this thing up so uh okay and then I was around. I had to run some stuff and I didn't have a computer, so I had to run it in the ci and I pushed it to the same branch. So this is the last commit you all remember because of this video series, so um so.

A

Okay, yeah so- and I think that was around the demo last week- yeah, okay, right after okay and then I forgot to commit this one, and what was this one? uh This one was oh yeah, this thing right so when we did our little quick and dirty support for the um links um which you know, we probably didn't need to do yet. But here we are, you know, we're figuring things out doing it the best we can.

A

So um uh when you re-import right from a json, it's going to load as a list rather than a tuple, and so it didn't account for that, because hadn't run the code yet so um here then we found out we needed to add a little list there to this instance check. So I also created a label called alice, and so we can tag any issues with the alice label. Now that are that are pertaining to alice uh just to help us stay organized a little more okay, um all right, let's jump into it.

A

So I think what we'll do is um we'll uh I mean we should just. There should be like two functions, two or three yeah. This is two functions. I think I know there's a few functions: okay, so check for status of common files.

A

B

A

You better not be pissing up there, goddammit.

B

Here he comes ruffles.

B

A

B

A

Can you say hello.

A

Here, I'll, let him say: hi.

A

All right, that was all we got: okay,.

A

How are we going to do this? Ruffles? Oh he's got an alternate implementation for us.

A

It's called snuggle time. um I don't know if that's going to work here, ruffles, wonderful, wonderful implementation, not sure if it's appropriate here. Okay um for this one, we're going to use functions, python functions a little bit of different methodology. Okay,.

B

um Now the trick.

A

Is how to keep him satisfied? Okay, ruffles.

A

A

A

I love you, but I have to box you out. Okay,.

B

Jeez alice alice. What was that? What's that.

A

Okay, so so threats, so how do we make threats? Okay, so threats is actually a run. Single seems like awfully complicated for just making one class. Is there an easier way we could do this.

A

Let's not worry about it now: okay, so run intersection.

B

B

A

A

Okay, so we want to take that we want to overlay this flow. So, let's get tomorrow, let's get tomorrow.

B

A

Okay: let's go take a look at that. Okay, this is not working for me.

A

A

There's a record set okay, so we can just subclass from this and we can say dataflow.

A

Okay, no because we need to support the overlay okay, so this worked okay. So if we had our system context at cli command stuff already, this would be easier.

A

Right so because this thing run record set takes data flow, actually, you know, run record, set and run all records. Okay, so let's actually just go and modify those to take an overlay.

A

And actually, let's modify them? Yes, so, let's add those files operations interferes to from first and center source, okay operations: okay, github workflow present.

A

Why are we importing subprocess.

A

Oh wait: did we already do this.

B

A

Yeah, okay, so what am I debating on? Why is this taking me so long? Okay, so um did links.

A

If we, we put the links on the definition.

A

We put the links on the definition I'm trying to figure out if we have an input object. Okay, so if an operation were to take an.

A

Input: okay, get parents where's that.

A

So this has been.

A

Oh, oh! No! Oh no.

A

A

There's an open issue for this okay, so why is this such a problem? Well, those parents- they all- have to be in memory for this to work. That goes against everything that we do. um This should be async where you used, you should be async.

A

And okay, so the input object. That's right! We can re it's been years since I looked at this okay, um the input object here and get parents, so specific input objects. We could subclass the input, object and have the input network uh then.

A

So this would be basically memory input and then um there would be other inputs and then basically, uh when you instantiated them from the input network, you might set the input network as a property and then, when you did get parents you would call into the input network and grab the parents specifically to the way the input network would want to get them and you would do it asynchronously.

A

So because, obviously you don't know if those inputs exist in memory yet or not,.

A

So uh so this is a bad. This is very bad, um so let's make it async and see what explodes.

A

A

Yeah look at this. This is just disgusting. Okay,.

B

A

It's gonna up so many things: okay, all right! Let's just do it just getting it done we're getting. It done, wait! Wait! Maybe I should just not do this right now. I don't have time for this right now.

A

I don't have time for this right now. It is 7 23, okay. I don't have time for this right now.

A

It's not gonna, just be one little quick change, I'm trying to justify it again. Okay,.

A

A

Okay, bail, we're bailing we're assigning that issue label alice all right. Let's go find it.

A

Issue: 52 yeah- that tells you how old that is.

A

A

All right now it's got label alice on it. Okay,.

A

All right, so here's our house, stuff.

A

We need to sync to do's: remember we're going to synchronize state across time um when we go back to dumping the thread so we'll. Eventually, we've had another open issue to sync to do's across github and issue the code base and so we'll get to that, and we do that as well. All right, okay, be chill dude.

A

Okay, so now, hopefully we won't forget that one.

A

A

Do this as well, I think that's the only thing with that name: okay, oh man, oh, but look at that. Oh it would be so easy. Oh.

B

Let's just do it, let's just do it.

B

Oh okay, we're just gonna! Do it: okay, okay,.

A

All right, okay, don't tell me that I'm doing this, okay, um okay, we're gonna! Just do it real, quick.

B

A

All right, so this is so. How do I okay? What? If? What? If you, okay so you're doing a common refactoring thing right? Okay, change everything! Okay, so do gate grep for whatever the hell you want to change right and then basically just take out.

A

Use sed to remove everything after the colon on the output there, and then we can do sort unique and now we have all the files we need to edit, and uh when we do that, then we can just go vim and then here we go now we're just gonna do all of them: okay, so get parents, okay, plus.

A

Okay, so, unfortunately, input is a reserved word in python, so you'll see item in place of input in the code base everywhere.

A

Okay, all right that one looks done.

A

This is the one we already did. I'm gonna copy paste the line.

B

A

Okay, wait a minute wait! A minute. Am I collaborating the name item? I am.

A

Oh jesus, I I apologize okay, um this is disgusting. Okay, I apologize.

A

All right, okay, we should be done.

A

Let's see so item async 4 item in parameter order in japan.

A

Okay, so now remember a parameter is a basically like the I'm about to call you version of an input.

A

B

A

A

Okay, it looks good to me: let's do diff on it.

A

Looks good to me.

A

Those are all I think, methods. Okay, all right here goes nothing.

A

Make your parents async.

A

An async iterator.

B

A

Want to put a note on.

A

All right, so, where are we at in our little stream stream stream? Okay,.

A

B

Give me one where come on give me a python all right, all right.

B

A

I will say 17 times, 60.

A

Actually, probably sooner than that,.

A

All right, so that's the time.

A

B

uh Okay, it says access.

A

Opened about three years ago now, it looks like last year. I thought that.

A

B

A

A

Pretty sure we need to make input.

A

Memory input rename.

A

Input to memory input and then have get parents.

A

uh Optionally, take the um take an input network.

A

Right and so what do we do if we want to actually use multiple input networks, we create an input network which is an alias for multiple.

A

Similar relate to what we do with source sources. Okay, so.

A

Then now inputs, if they are not cached in memory.

A

All right, okay, I think we've documented that sufficiently now.

A

Okay, why the hell were we talking about that? Oh.

A

Because I wanted to get the parents- okay, so um okay, so we're gonna refactor the operation implementation so that when it takes, oh god now, I don't want to do that right now.

B

A

Okay, we're just not gonna, do that right now, we're just not gonna do that right now: okay,.

B

B

A

And use import.

B

B

A

General battery desperately in need, okay,.

A

B

All right, okay,.

B

All right, okay,.

A

All right, so, let's jump in here.

A

And let's just create a few more of these.

B

A

Good repository another project.

A

Why does that say, returns.

A

A

A

Check q reboot check for read me.

A

A

Okay, I should not contribute.

A

A

Okay, so we're running it, so you can't do an async iterate. So you can't do this within this okay.

A

That means are lovely. That's why I didn't do this earlier, because I like the way this generator was.

B

B

B

A

A

I don't think we need to do the deep duplication at that level.

A

So we add to the list of parents, so parents append.

A

A

Okay, so it's mad about us on the other file.

A

All right, so it's mad here.

A

All right, so we're going to do the same thing. We're going to create this parents object.

A

Which is not going to create it with the generator once again, you know, why is everything generators, because then it's pretty quick and easy to see what the hell is going in there it's hard when you have a bunch of for loops.

B

A

Okay, intestinal attribute export, so my guess is we're yielding something incorrect here.

B

A

Let's just try that okay keys.

A

Routine, okay,.

A

Okay yeah, so we actually have to go through and yield in the other one, because our lci it'll just return a list, and we don't want to return a list. We want to return.

A

I wanted to be a stream and I think iterator is basically a stream. We love streams.

A

I think it might be running.

A

It keeps getting locked up at this lines of code to comment.

A

On the lock acquisition.

A

A

Why is it doing this? Okay.

A

Dispatch lines of good comments, dispatch lines of good comments.

B

A

Dispatch acquiring so who has the lock acquired.

A

So someone has a lock.

A

Oh, this does not exist debatable.

A

Okay, oh it doesn't do it if the debugger's attached that's right!

A

Okay, no! It does okay, great.

A

A

A

A

Okay, so I'm trying to debug here all right: let's grab the event loop.

B

A

All right, let's see what do we got here, so we have a bunch of async generators. Okay, looks like they're all okay running acquire.

A

Okay, async gens, okay,.

A

Maybe I don't know anything about those using gens.

A

Okay, here's all the asic generators.

A

A

A

Blank memory lock network.

B

A

A

So removing the subprocess okay, I rebased in this guy so get checkout dash p head minus one dash dash okay. So basically I accidentally added this operations. It diff dash dark, get locked p, dash dash operations; okay, so.

A

All right, so we didn't want this change to this file right, so uh we can t that temp patch, all right. So let's reverse it so git log. So we just want the last commit reversed, so n1 and then dash capital. Rs, reverse dash p is showing me that show me the actual diff in the log just for operations and we wanted to go to temp patch right. So now we can go through and we can apply this so I'm about to take it out so get there. So so that says, import soap, pot process.

A

This says minus impulsive process or no we want dash. So this should be t10 patch, okay,.