DFFML Rolling Alice: Engineering Logs: Volume 0: Architecting Alice, 29 Jul 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Rolling Alice: 2022 Progress Reports: July Activities Recap

Description

See https://www.youtube.com/watch?v=u2lGjMMIlAo&list=PLtzAOVTpO2ja6DXSCzoF3v_mQDh7l0ymH or skip to https://www.youtube.com/watch?v=JDh2DARl8os&t=313s for contributing to Alice please contribute recommended community standards
Status Updates: https://www.youtube.com/watch?v=THKMfJpPt8I&list=PLtzAOVTpO2jZltVwl3dSEeQllKWZ0YU39
Engineering Log: https://github.com/intel/dffml/discussions/1406#discussioncomment-3279821

The first 5 minutes of this where we do the download and fight the network got lost.

A

Right so this is our progress report update for july um and uh we're just going to do a little recap of what happened in the month. um So alice is finally at uh she's, ready for contributing now. um So that's linked here and so here's here's, the contributing docs, let's see so what else?

A

um I'm not gonna. Look at the computer. I'm gonna try to take some time just to step away um so everything you know you all have all the docs so um and all the engineering mods so wow. This is good. I was being kind of slow today, okay, so what we're going to do is we're going to run through the um contributing documentation right now and then we'll talk a little bit about um you know where we're going and and what we've uh what we've aligned on so far okay.

A

So I left a little note here. You know about about. What's going on so basically you know here's! Here's, the pr right, we're communicating essentially through or well through the pr and then the engineering logs going at engineering comms. um So uh all right, so, let's run through uh contributing to alice okay, so I'm gonna go ahead and create myself a temporary directory.

A

Okay and then we'll run to clone the repo, um and this is of course referenced from the readme. um So if you get to the readme and you're wondering hey, you know how does uh alice work. Wow github is real real slow. Today.

A

A

Oh okay, come on. I'm sorry! I'm sorry! This would have been uh would have been a little faster here, but uh I guess we hit at a bad time.

A

All right we got it okay, so then we go into the alice directory right and we're going to go ahead and create a new virtual environment.

A

um You don't necessarily have to do this right, but it's helpful to isolate your dependencies sometimes, and so we recommend creating a new virtual environment and then, after you're done creating a new virtual environment, then we do the pip install command this large one here um and that's going to you know, install alice, which is the dot directory because we cd into there as well as the other plugins, that we need that that are installed in development mode.

A

So um then the next thing we're going to do is we're going to create a git repo right. So we're going to create this my new python project, so we can use the cli and we should have configured that already. So if you look at the the contributing docs, it mentions um that gh and github are both required and the I believe, oh the readme needs to mention that as well. Okay, so let's create the project okay or create the repo.

A

See a little bit slowness in the github api, okay yeah looks like they're having some trouble over there.

A

All right to let's time out, handshake all right experiencing some network issues today,.

A

Okay, come on just trying to create a repo here.

A

Is it my internet or what's going on? Is it github.

A

Okay, google loads fine, so it's github! Okay! So all right there we're jumping back out and we can go ahead and get rid of that directory. Now.

A

Right and so if we were to look at my project right now, it has the test py file in it right. Okay, so now we're going to ask now we're going to have alice contribute. Actually we can have alice. We can run the command first and we'll see. Okay, so alice is going to contribute for us, um the readme and uh community standards right.

A

So here's the contributor, sorry she's gonna, contribute the contributing file and the readme okay, great so, um and I'm gonna go ahead and run this command down here in the debugging to go ahead and delete both of those four requests. Now because we're going to do another thing so now, what we're going to do is we're going to extend alice right, so we're going to have alice, contribute the code of conduct file all right. So then we basically just do our find and replace um on that file, so we copy from an existing overlay.

A

So from the readme overlay we do a find, replace we plan to replace everything, that's readme in the various title, fully uppercase or lowercase and code of conduct, and then we go ahead and we add the overlay code of conduct to the list of installed overlays um when recommending community standards is run right. So anytime the recommended community standards flow is executed and the installed overlays are not overwritten. Then we'll see code of conduct loaded from the code of conduct file.

A

Okay, so uh then this is just showing us that and then we need to add.

A

So we also need to add to the entry points file, the definition of the um overlays, which should be applied to the code of conduct flow itself right, and so those are overly getting overly github to help it figure out some branches and stuff, so that code is in there and you should take a look at that code right. So you should take a look at the code in alice. Please contribute recommended community standards, that's basically where all the code lives.

A

So at this point now we can run the reinstall on alice and we can ask her to contribute the recommended community standards again. So now we need to be aware that she is operating as our account right now, um so when you're using gh she's she's signed in as you right. So let's see what are the pull requests saying so code of conduct? Okay, look at that all right and then the readme okay.

A

So here is the code of conduct.md all right, so now we could go and we could change those files. So if we wanted to, we could go in here right and go to conduct contents right. So we could say.

A

Code of conduct right so, let's just.

A

Okay and now we can.

A

Close those off again, we can run it again and we should see that the code of conducts the contents of that code of conduct- that's being contributed, has changed all right so and then the contributing the alice contribution. Docs um here so come on.

A

Oh yeah, that's right, github is being slow. We got a few seconds of goodness. Okay, so this is running, create contributing.

A

This is stuck on here. It's probably stuck on some github operations in progress, um okay, so this then in the contributing docs themselves. It goes over. Writing, uh oh, like just random little overlays, and so uh this is, like you know, hey. If I wanted to read from a config file, how would I do that right? So you could then okay. So let's go check out our pull request go to conduct right.

A

So now we see it says: code of conduct, okay and so there's other stuff that you can do where you can add inputs, one off.

A

A

Repose, okay, so this doesn't support adding overlays as one off, so you have to install them. Okay, um all right, okay, so that's great, so that is our alistar open source guide right. So now we can also list here just to see: okay yep there they are sweet. Okay, so there's our contribution. So now you can extend alice. You know, following this methodology um to uh to contribute arbitrary files right, and so you can also you know, maybe inspect the context, contents or look at auxiliary sources of information uh by following similar.

A

You know this writing operations within the contributing and then going beyond that. There's also, you know the should I and the metastatic analysis tutorial where we talk about. Writing should I, which is the stuff that's currently used in just the scraping without the proactive contribution and then there's the extension of. Should I, which talks about overlays a little more um okay, so I think are we does? Is there okay?

A

There is a screen here, okay, um so other than that- let's see so oh yeah, so it's sort of a self-fulfilling prophecy again, because we're writing alice and now alice can contribute code. And so then we can arbitrarily extend alice to contribute more code and then eventually else will just confuse herself right and it'll. Be yeah she'll be rolling, so um okay, so ietf, okay, so the the scit, the supply chain, integrity, transparency and trustworking group. I think uh we'll uh I'll rejoin that in september, so others please jump, get involved in that.

A

That seems like a good thing to get involved in um so we aligned with the opens, do open, ssf, identifying security threats working group. We talked to mike um who's, leading that and who also is, uh I think he might be, leaving the the omega the alpha omega stuff. um So we got. uh We got alice omega alpha, helping out with the open ssf uh alpha omega here, um so we'll try to try to get everything from all directions right.

A

um So hopefully uh we talked to them about how and- and you can see the working group recording for. uh I think it's posted public, so we basically talked about how you know s. I s c, I t t and the s I c t t architecture um seem to be very compatible with the stuff that we're doing here at the open architecture.

A

We may have probably like a little bit extra uh stuff around policy and then the threat modeling portion of this, but I my guess, is that s-I-s-c-I-t-t will provide a really solid foundation for us to build on. So we should really collaborate with them on that spec um and and try to figure out. You know how do we make that a success uh so uh because it looks like they've done great work there and you know we just want to make sure that we understand it and that you know we contribute where possible right.

A

So anyone just get involved in that um and we talked about you know how this stuff could be potentially used for the vulnerability sharing as across the stream made and need to align those the the working group with the stream and the activities there uh and then also there's some some various graphics um that we put together. I think we stream some of the putting together okay, so it's just my local connection, maybe um but yeah. So basically, you know here's! Here's, here's alice! Actually you know what this is it.

A

So uh I think I think we're good here. You know uh everybody. You all should be able to have uh plenty of fun for the month of august um and uh yeah, okay, the absent talk, talk will probably be posted where we did. The first live demo, balance um and yeah. I think we're pretty much good to go right. So at this point the other thing is that they're contributing so under here contributing a party to plug into the second or third-party plug-in ecosystem.

A

So obviously we still have to do some work on second party but effectively. You know the third party is, is game right, so we're good to go here at this point, so this stuff should work um and you should be able to start just like publishing packages um and installing alice overlays for things uh we'll need to go through so in the cli um cli, so in the cli. We're gonna need to go through and extend this um to make it.

A

uh You know to make the commands like this is just not very clean right now, so we're gonna fix that up later um at this point, if we want more commands, we can just you know copy paste so, but other than that everything is pretty much in alice. uh Please contribute so.

A

Okay, all right, so it's basically these file or actually so.

A

All right, so it's basically just these files. You know so there's not a lot. There's not a lot going on here. um It should be, hopefully pretty digestible and so yeah.

A

A

Okay, so yeah mess around with these files uh have fun. I think you're gonna have fun, um and if it's only alice watching this well, then alice have fun. Okay, so and alice. Here.