Open Source Ecology Admin Automation, 22 May 2021

Previous Meeting

Next Meeting

⏯

youtube image

►

From YouTube: Advanced Find-and-Replace of Text Files

Description

Automation workflow for large ordinal lists where the syntax of each line is complex and has multiple numbers that change. Increase by 1. See notes at https://wiki.opensourceecology.org/wiki/Advanced_Find_and_Replace

-----------------
What you see here at Open Source Ecology is an ambitious open source project for the common good. Join our development team:

http://opensourceecology.org/wiki/OSE_Developers

We run One Day Extreme Build workshops in many locations. Please put yourself on our map if you'd like us to host a workshop near you:

https://microfactory.opensourceecology.org/request-a-workshop/

Take a minute to subscribe to our email newsletter (updates, workshops, etc): http://bit.ly/1LtcM44

A

B

So the question is: how do.

A

We change large lists of text where we only have to change a small part part of the text, so this is kind of admin work, but it's applicable to, for example, part library, so we've got wall modules in sweet home 3d. We got to do 69 of them in total, and here we have a part library, a gallery now, what's the what's the text.

B

Underneath it look like.

A

B

A

How you do the part library file a bunch of text, but you got to replace the number from 1 to 269.. Now, how do we do this? So we start by putting the text into a spreadsheet and divide it in such a way where the number that you change is the last in any given column so, for example, cd home 2 wall 1, um just to show you this. This is this is what I put into the spreadsheet.

A

So this number at the end is the thing that's going to change.

B

Okay, so now, if I've.

A

Got a total of 69 wall.

B

A

um Let's just drag.

B

A

All the way to 69.

A

there it is so now this has changed from 1 to 69. I didn't have to do this by hand.

B

A

From here on, we've got to get rid of some of these spaces, so here we can use, find and replace to online. So let's, let's do that. uh It's called unit dash conversion.

B

Dot info in the link.

A

In a link in the video description uh so find and replace text so now we've got our text, so we've got a whole list of stuff. It's not formatted perfectly well, there's some extra spaces because we're just using a a.

B

Spreadsheet, like here.

A

Which does that so.

B

We're not using any special.

A

Program just using online tools; okay, so we gotta get rid of these spaces and mass, so we start doing that by okay, for example, here we've got an extra extra space.

B

A

That space replace.

B

It with just a period.

A

Let's find that again, so there's that space control c control v and it's not working for me there, one two three.

A

um One there's.

B

Two spaces: there.

A

So that should do it replace text online, fine text replace with.

A

Let's try this find.

A

B

A

A

Well, in principle, this should be just this dot here: okay,.

B

Good, so we replace.

A

This space here that space there break so now we copy all of this ctrl a and paste it into the let's go through this again, because there's more spaces to copy and paste, I messed it up.

A

Oh, let's try that again, ctrl c so.

B

This is you got to get good at this. You got to.

A

Mind your spaces in every little detail. But if.

B

A

Right you'll make it work, so here we got rid of the first space already ctrl a ctrl c, and then we paste.

B

It up here so this is better.

A

B

We get rid of this space here so take this.

A

B

Of that space, ctrl c.

A

And replace that with just the apostrophe okay.

B

There so we got rid of this spacing so now.

A

B

A

Now we get rid of the last space here, which.

B

B

This space right here.

A

B

Looks also like we've got.

A

Do we have a line break there, not sure? No? Actually we don't that's just how it appears on.

B

The screen, but here we've got to get rid of this space ctrl c.

A

Ctrl v and replace that just with the one bracket. So as you see here now, this text is formatted well now.

B

What's missing last thing: that's missing is space carriage breaks.

A

Between each each line, since this is going into the wiki, like you see here in the wiki there's.

B

A space between each line.

A

So now we're going to go to the so we got the correct text here and our point where the return.

B

A

Going to be is after the double bracket, so we're going to do add line.

B

B

Needle needle is the place where you actually.

A

uh The point where you replace, but now it may make this all disappear, um see if that's still correct yeah that looks.

A

A

A

B

Good to me, so we just.

A

Need a return there we go so first, I gotta ctrl a on this ctrl c. So now, when I go to add line.

B

A

It makes everything disappear, so I gotta paste it in again, but.

B

Yeah, that's what it did after this double bracket, which.

A

A

Let's hope it didn't put a double a space after.

B

A

Yeah, it did so, let's reframe that to say double bracket space.

A

B

Then the result should be.

A

B

Didn't do it for.

A

Me um where, after before, after okay, so let's try this it did that. But how does that appear in a wiki? Now, oh got the space in there.

A

See it gives me and this unnecessary return here so.

B

I need to fix that.

A

And to do that, why don't we replace so this is.

A

B

Could probably take.

A

The space dash dash and replace that with no space dash dash. So how about that? It's ctrl a ctrl c. Now we got to go back to the find replace so.

A

B

A

Want to get rid of this space here so we're the return there. So ctrl c here do that and replace.

B

It just with dash dash.

A

A

A

Oh, I think maybe what we need is.

A

B

A

B

A

With dash dash.

A

A

No fine text replace with what's going on here. It's not working.

A

B

I'm trying it okay, so.

A

Okay, let's see did that get rid of the space. No, so I'm.

B

Trying to get rid of this return here.

A

Add line remove line breaks so let's try that again, ctrl.

B

A

Ctrl c: let's go to remove, remove line.

B

Breaks input, data.

A

A

A

Yeah, it did remove the line bricks, but now, how do I add the line break where it's supposed to be and.

A

So how would I identify the correct place here, so it's yeah, it removed all the breaks, so maybe.

A

B

A

A

Space file, because file is supposed to be the wherever.

B

A

B

A

A

B

A

Break before space file, which is only at the very beginning, so let's try that ctrl c.

A

A

A

B

So, let's remove.

A

Line breaks and here we're going to go to add line breaks so go.

B

A

B

A

Should be added.

A

A

B

The unique identifier.

A

For the location where it needs to be.

A

um If you look at the very beginning, zip, okay,.

B

It should be before.

A

B

A

A

It's either after before, or instead.

A

uh Can we get rid of a.

B

Space instead of a space.

A

No because there's spaces here, space f before space f.

A

There's no good.

B

A

Identifier here: um how about.

B

Let's just take sch2.

A

B

A

Like before this, because this yeah this.

B

Is not found anywhere so yeah.

A

Add a line break before this, so the needle is going to be. That means where you're, taking a line, break and say before did that work.

A

A

B

A

Before how about after.

A

A

B

Got pretty close here, I'm just going to take this then.

A

B

A little technicality here.

A

Which prevents me from doing this effectively, but let's control c and now we can actually put in this whole gallery in one piece: control v bam! It's right there. Now, let's see what that looks like do. I get a big gallery of empty spots. Yeah.

B

A

Get a big gallery and it it titles: does it title it correctly? So wall module one sweet home, 3d shd wall, one, and then it goes wall two wall. Three. Now the build cheat sheets? Oh there's a triple, uh there's a triple mark there. So that's not working! I need a link to the build cheat sheets.

A

Where did that come from oh yeah somewhere? I messed it up here in this process.

A

A

Go back to replace text so go back to this um now find the triple bracket and replace with double bracket.

A

B

A

Should be good now, let's redo this here, one two.

A

So, let's replace this ctrl v.

A

And did I seed a library from part 1 to 69 yeah.

B

That's good! That's good!.

A

It gets me up to.

B

So this would take manually. This would take.

A

A bit of time now I was fumbling around with it find and replace, and the spreadsheet thing uh I'll link to these things test call it test. It's an advanced, find in a replace workflow test, advanced, find and replace great I'll link that in the video and I'll link this tool here, where we went through the successive find, replace and then add line breaks. So this is a.

B

A

Do it, if you don't program this in, like with python or whatever language um I was.

B

Trying to find a quick way- and it's if done right, this probably.

A

Could be quick here once we get a hang of it but yeah. It definitely takes some mental manipulation. Mental gymnastics to make this work because you got to keep track of all your punctuation very.

B

Carefully but we did end up seating. This whole.

A

Part library and now we can get to work on filling in all these modules, so I'll leave it at that.

A

B

See did I miss any details.

A

I'll send a link to this, and this and of course this is collaborative development. So if you have an easy way to do this, meaning if you have.

B

An ordinal list.

A

Of complex syntax, like when you're doing, programming or wiki, editing and stuff, like that, how.

B

Do you very simply change the number.

A

From one to two to three to four and.

B

So forth for a very large list now here we have 69 items.

A

Imagine we were working with.

B

A

Like an order of 100 or a.

B

Thousand I mean this would.

A

Definitely make sense to do it automatically like.

B

A

By copy and paste using simple tools, so you don't have to program it, but that's the idea, save yourself a little bit of time by automating this administrative work. Thank you leave it at that.