DFFML Rolling Alice: Engineering Logs: Volume 1: Coach Alice, 10 Jun 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Coach Alice: Volume 1: Chapter 1: Part 5: Generating THREATS.md using CVE Bin Tool Output Engine

Description

https://github.com/intel/dffml/discussions/1369#discussioncomment-2663771

A

A

So we change the name.

A

To drop the underscore, I guess that didn't make any sense. Okay, so we cloned the repo. So I also realized we can add these operations ben sick stuff in there.

A

Okay, we put a directory, okay, fantastic, so let's scan locally.

A

Okay, fantastic.

A

A

A

A

A

A

All right, okay! So what do we need to do here? Type check, 30 minutes.

A

Okay, so we have it and gives us a.

A

Directory all right.

A

Ugly, okay, so.

A

Bad argument would be great if we could go from arc parse back.

A

So mean so, I think what we'll do is.

A

We'll split out.

A

A

So the output format, output engine.

A

A

A

Okay, let's check out see if we can make an output format here and then we want to tie the output format in with the data flow output, stuff output, engine and net output, console output, engine console output, html so amplify alpha type console.

A

So let's go check that out.

A

Okay, if output type equals console.

A

All right, so, oh now, output console okay. So there is a file name. So.

A

If output type I'll put cvs output cvs so I'll put html okay, so we'll add another output, type threats, dot, md.

A

And then output threats.

A

Okay, I'll pretty chanel.

A

A

Alpha type threats, archetype.

A

Okay, let's see so there's an output in any time putting it down.

A

Appetite output, cvs.

A

A

I'll put file.

A

So sweeping tool cli of a file.

A

Args output file.

A

File, okay, so.

A

Provide up a file name: okay, format; okay, so here we go. We want to add here, threats.

A

Ours format, output format,.

A

Okay, helpful file, output, format, okay and our output format is threats right.

A

I'm going to file alpha type threats.

A

Okay, so we're adding our new output type of threats.

A

We'll copy the html engine to the threats engine.

A

And let's say, output rats all right, so that's, okay, html templates, merge four times: let's get in by okay. 36 time check we're at 36 right now. Okay, so.

A

uh Step one level.

A

So this produces a threats.md report for uh depends, he's found.

A

All right so all cv data products of cpu products without cv, total files, scanner, merge report.

A

So, let's see what we've got here.

A

A

Okay, so let's look for examples of how to use format csv for my console for my html.

A

Color data format- okay, so pdf, okay, yeah, so okay, so python does m all right. Let's see, cbe pen tool dash h, dash, f threats.

A

Okay, download the data from the bd.

A

A

Okay, so then we need a threats: md file.

A

And so what are we going to do so? We're going to say.

A

We want a list of dependencies.

A

Let's do it so we'll create an example project here, so, okay and so here's our temporary directory um and we'll copy.

A

Okay, so we'll scan that directory all right, so no files or cvs and let's say.

A

Okay, so and input output file so.

A

And we see it came up there in the format list, format, threat, output, file.

A

Threats, dot, md.

A

A

So, yes, it will do we'll copy open ssl into that directory.

A

Lost a j there, the first time.

A

So this is our directory scan again. Okay, so now we have threats, md, dot, dot; okay, so, let's maybe say dot mark down.

A

A

Cli that md so we'll output, markdown and then we'll.

A

Okay, so we'll do it like this for now.

A

And we'll say format: md.

A

And so then, what we'll do is we'll add uh we'll add in so we'll we'll provide this. As what we'll do is we implement some basic functionality?

A

Then we allow for the application of overlays via implementation of the functionality via the system context, and then once we have that.

A

Then well then we can just you know, overlay whatever we want right. So when we install alice we can. um We can have her. She can apply her overlays to this. If she wanted to um or you could just it doesn't really. You know, analysis the architecture and the entity so basically by by having her in here, she's she's in here as soon as we import as soon as we use the system context, and so we have we aren't using it yet so um so she's not in here yet so.

A

A

A

A

Okay, I'll profile thread smd. So then maybe we'll do something like in here.

A

Okay, so if filename ends with threats.

A

Right so, if we're outputting a threats, md file, then we output threats right. Otherwise we raise not implement there.

A

Okay, so uh only.

A

Generating threats supported.

A

A

Great so only generating threats md currently supported. So let's see where was that.

A

Does it already have the md appended okay, so.

A

What's the problem, why doesn't like that so I'll put blank whatever I'll put whatever done I'll put file, self.file name, oh out, file,.

A

Tempted output to.

A

Okay, I uh texture textile wrapper.

A

Where is out file coming from.

A

A

A

A

I wish we use f, self.filename output type.

A

But what about out file.

A

A

Okay, threat set md.

A

Okay, so it just changed: okay, filter rate file file already exists. Okay,.

A

Okay, so if output is cell filename mode as f y, why do we do this here?.

A

I think we're getting checks off on him now.

A

All right here we are okay,.

A

Okay, print locals; okay, so uh oh file.

A

Right text wrap dot d dent.

A

A

All right, so we import text wrap just so. We can keep that nice and clean there all right there. We go.

A

This is, I think, a ritual to this. Let's see.

A

Okay, so ducks weren't we doing this somewhere. Didn't we do this before.

A

A

No alias again all right there we go so now we're going to continuously run around this gpy.

A

A

And then we'll say, update, never.

A

A

So what command are we running here.

A

A

Okay, so this is the command we're using for testing right, so.

A

Below is the command used for testing.

A

A

All right and we'll say, uh output engine threats generate.

A

Threats, dot, md file.

A

A

So what do we have here? We got.

A

A

Let's generate a mermaid diagram graph td and.

A

A

We'll put whatever we want here, all right, so graph2d.

A

Okay right the mermaid diagram right, and so how can we do that? Well, we have our we can. We can generate a data flow and then the data flow will write out the the diagram right. So uh how did we do that? Recently, we did read and find dfml operations in your source.

A

A

A

A

That's right, so how do we do that.

A

Tests smartest.

A

I swear, I wrote a test for diagram somewhere recently. Didn't we just do this.

A

A

Two attackers.

A

A

A

A

Oh here it is okay, it's in a wonderful. It's an example.

A

All right there we go.

A

So what is this telling us? This is tinus.

A

A

Okay, so then we just need to.

A

Set no pace; okay, switch to.

A

With context, live dot redirect std out to out file.

A

Are we on the youtube? We are on the youtube right and then we run that one and then that'll dump the diagram to the.

A

Okay, look there. It is okay, so why is it not happy? I found out right where my diagram, oh.

A

A

How did I get the graph in there? Oh there, it is okay, oh oh holy! This is cool holy. This is cool, oh my god! Oh my god. Oh my god. Okay! This is great holy in the nick of time. Okay. What are we gonna diagram? Let's diagram something. So we gotta import a data flow okay default factory, this guy lambda, all right where we come from where we come from. Let's grab the collector flow from, uh let's grab the collector flow from.

A

From the scanner all right.

A

A

Okay, so to do, let's add, try or add a try around import of diff well to generate data flows which output mermaid diagrams.

A

All right, okay, so we're going to use dfml to generate that so.

A

A

Check if now is installed or check if uh data flow extra is installed.

A

Build data flows from scan results.

A

Generate memory diagrams.

A

From flows all right.

A

A

Is the collector flow empty.

A

A

Okay, let's cat that and we'll put it in as the example in the pr and then I have to go actually here: let's throw it in the pr first.

A

Okay, there we go perfect, look, we got armor marked down.