DFFML Rolling Alice: Engineering Logs: Volume 1: Coach Alice, 9 Jul 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Coach Alice: Volume 1: Chapter 1: Part 37: Collector Result Storage

Description

https://github.com/intel/dffml/pull/1401#issuecomment-1170489046

A

So you know what I just realized. I was going to say that their next perspective was to try to save the ssi database, and I realized you know we really did the distributed web node functionality I just saw, is not yet integrated, so the decentralized web node messaging.

A

So it doesn't really give us a lot of to save in this format right now. So I think what we'll do is we'll just implement a source which goes off and saves saves our data somewhere. So where should we save our data?.

A

So, let's see what is this spaces create a space.

A

Okay, api docs.

A

Okay, so let's do, and actually this is a chalice thing right, so we're. Basically, we want to run all these scans right, um so how we're going to run all the scans.

A

um What are we on.

A

Yeah, so we want to run all the scans of part 37.

A

Okay, so this will be uh where to save.

A

uh Let's see collector, let's see collector the uh results, storage.

A

Okay, great! That's what we're doing.

A

So it looks like tv decks is uh so, let's make a note distributive web node functionality is not yet implemented. um So we're going to not uh worry about so uh serialization. For now so d d, w n decentralized web node.

A

A

Not complete yet.

A

Will loop back when it is uh for now we will shoot a space.

A

A

A

All right, so how are we going to do this? So, let's see so where's the api docs.

A

Look at the digital.

A

Let's create a space.

A

Okay, let's create it in san francisco, so everybody can listen. It.

A

It will see one.

A

A

All right, seventy percent fast yeah- we don't want caching right now- choose a unique sub domain. Okay, so this will be.

A

Results.Alice.Should, I dot contribute.

A

Okay, so results.alice that, should I contribute okay that looks good to me not to eat.

A

A

It's your name invalid, because it'll probably be odd soon enough. It's probably just a time. Sync error: okay, so file settings, okay, so let's enable file listing so that everybody can see the results.

A

Okay, so now, okay, origin, okay, so everybody can also grab the results, of course, um and okay, so great so looks like let's see if this results now: okay, let's so far, no okay, so the cell search still not there, okay, so upload files. Okay! So let's take a look at the api so created.

A

So trying to figure.

A

And then we'll write a source after.

A

That's the collector flow okay, that's the game plan.

A

Okay, so let's let's play with the create an access token great, so are you all going to keep your all you're all going to see my access token?

A

All right! That's fine! So then I'll have to revoke it immediately. So great.

A

You know what I can do is I can actually okay. So this is the page.

A

A

Okay, so let's follow the docs: let's create the access token so go to the control panel.

A

And go to the alice project? Okay! So, and what do we do so? Control panel click api link in the main navigation? Okay, access? Oh, wait: tokens! Okay, generate a new token; okay. So what's that? Should I contribute? And I'll say this is pdx johnny? What was the email scope that we made?

A

um We did this up here. We did the ssh key. What was the ssh key domain out of curiosity contribute? Okay, so this is pdx. Johnny dot contribute dot. Should I dot alice.com?

A

A

Okay generate tokens now here I'm going to cut the display.

A

All right here we go now. I have the token okay, so I copied the token and.

A

Okay, so I'm creating this on the let's see: where are we so we should be on.

A

What machine should we be on? Okay, yeah? Let's I guess, let's be on this machine. This is the one that's going to upload. So, let's make through this config doe.

A

Okay, now we'll say echo.

A

Where's, the it's so.

A

Bim config do pdx johnny dot uh contribute dot. Should I.

A

A

Historic bead, okay and there's a token in that file. Now so now you can say export vo token. Access token equals that file and now the access token is there. Okay. So.

A

And we'll just put access.

A

uh Export the token, the token has a variable on the.

A

Within the server dmox shell session.

A

Okay and then now we need to look at the api: okay where's the api docs. So we need to go back to the api docs, okay and api usage. Examples. Okay, so yeah so export token equals whatever okay. So they do token. So, let's do token, so we can copy paste our commands.

A

Okay, so install actions all right, great okay, this is good. So it's working so list all droplets.

A

A

Create a new droplet okay. So what do we want? uh What are we working with the spaces api, so libraries, uh python.

A

A

A

Okay, this is active okay. This must be the thing we're already using okay, great.

A

Okay, let's do to install.

A

So so our references are.

A

And how did we get there.

A

Okay, so now install python.

A

Library or interfacing.

A

A

Okay, I'm also gonna link to the info pr.

A

Okay, so we used this.

A

Okay, so we install it and then what do we do so now we need to see where's the docs so.

A

Okay, so let's actually okay, so now it looks like this is saying: export it as digitalocean access, token, okay. So let's change our documentation.

A

A

Okay, so listing projects? Okay. So what do we want? Spaces spaces spaces.

A

A

A

So I don't understand how we use the.

A

Here's the api reference: okay,.

A

Okay, clear: how to use spaces api.

A

Okay, so let's do let's go over here. Where is.

A

A

A

A

Api, let me just go back.

A

Okay, this is it icon, 3.

A

It says key pair.

A

So we didn't even need that.

A

A

Okay looks like we're here now so.

A

Okay, so configure client.

A

This space is key.

A

Okay and the spaces with access keys.

A

This is not my favorite right now. Okay, so.

A

We need to automate all this. This is too many steps. Okay, um this is great. Digital ocean is fantastic.

A

Oh, this is too many steps: okay, so sharing access to spaces with excuses.

A

Okay, great okay, so you can create an unlimited number of access keys for spaces.

A

In this case spaces access keys.

A

Spaces access keys, okay,.

A

A

Okay, oh okay. Now I have to redo it. Okay,.

A

Okay, so there's a secret okay, so there's a secret value and there's a key value. Okay, so.

A

A

A

So here we're seeing this all right.

A

So we want to export the the secret and the key so uh create the secret, create the space e.

A

A

Reflecting, let's go.

A

A

So we go to this tokens url.

A

So go to this tokens. Go to this url create the space key, the name reflecting the scope. Okay, then export the key and the secret that's variables. So we.

A

Source and run.

A

The collective.

A

Okay, okay, so there is space.

A

So all right uh python script here, attempt to space.

A

Space contents. Okay, so let me export those secrets now.

A

That's here's right now, I'm saying okay! So if in this file that space key.

A

Or maybe this should be.

A

A

A

Sort of make a directory for it.

A

Now I put my key in the file.

A

And then I do the same thing for spaces. uh What is the secret.

A

Secret in the file and close the tab, alright close the file.