SunPy Developer Discussion, 28 Jul 2014

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: SunPy Developer Discussion

Description

More demos and hopefully some PR killing.

A

B

Okay, well I suppose the first thing we might as well talk about is this ghost function that we are having a nice little gap. Discussion on panola has been following. This is issue number 1121.

C

D

Link in the comments here in the group chat, I.

B

Think, ok, first off Steve. What were you suggesting? Basically.

D

The same thing that ever was is suggesting that we should just include all this in units and we don't need these individual functions well.

E

The question is whether you can actually implement it that way: I.

D

Know you can no.

E

C

Unix I tried and for unity I get made. You can change the extra pie, how it works by the pipian error. When you try to obtain a letter instead of a number, but they still, you need the function. It.

B

Don't you think it doesn't make any sense, because the ghost cost isn't a unit? It's a competent know.

E

Those classes are unit no.

B

It's not quantity, no.

D

No, no, no I think we're it's. It was.

E

A representation.

B

D

A quantity of what blah blah blah, so it's a quantity. It's not.

B

Too unit, so we can't implement it as an effort by you, because it's not you if.

E

We gave handle strings, it would try this really hard. Look at handle, string, okay in a strip I apply these, then we should be able to implement it exactly as we're talking about goes, class would be close. The unit system and an actual measured goes class would be the quantity there is no unit terminology. The unit is talking to me just button leaders the unit, but the number of meters. Something is also the quantity it's it's.

B

A the ghost number X 1.1 is a representation of a floating point number. It's not the representation to be using I. Disagree, it's a unit. No, it's it's a number with a unit. It is not a unit. Well,.

D

Regardless I mean the question is: can we somehow I'm pulling them something like this.

B

You can do it extra pie doesn't support what you're asking me to.

C

It fails a price I tried experience.

F

Of the physical separation between units and quantitation, apt x, I still.

E

Think Stuart, this is the distinction. Here is you're using a language, perhaps more formally than we are, but it is entirely possible. Treecko's classes and units yeah.

B

But it's in everybody: there is a pro pragmatical pro pro blah blah, there's a difference in the code between a unit where cheese meters with no number attached.

F

And quantity, which is provided by a new unit called goes class. The unit will be third plastic, I go that's.

B

Not a unit much much easier, it's about actually equivalent to what per meter squared no.

E

No, just like an urn is 10 to the minus 7 watts. You have a ghost class of 10 to the minus 49 watts per meter, squared okay.

B

But after my comp she doesn't pop straight. So that's it! It's a technical limitation.

D

Mm-Hmm is there anything else that anyone can think of where you'd want a string in some sort of like representation of a quantity, or are we kind of the only one I.

C

Don't know if they start like it, I wasn't in this big.

D

C

Of the star, like Oh, be my fine Joe hit me right now.

C

He had that heart of the letters and numbers and they may have bad SI ya.

D

Representation.

C

Of Tampa cure and I picked up last yeah.

D

Well, the specter class is not really, you know, convert.

E

D

E

Classes are very rigid, sista yeah.

D

It's just it's a silly. One is what well I.

D

Mean I guess as it currently stands, we copied.

B

Up on my comp, see after by changing the.

E

Closest thing you could do for us hope you get to it the terms of four units. We have a pugilist, you have goes class, a goes class b goes, classy, goes house and goes class X. You can revert a watts per meter square too. It's a miracle representation and goes class X units yeah.

D

But what can we just add? Custom representations to units, so you would have watts per meter squared but I want my custom. I could turn on a custom representation where it would print it out, as you know, X whatever, and it would be a representation right as opposed to you. You would subclass a unit that you define of watts per meter squared and then you would put up your own representation underscore underscore would represent, and they would basically act just like a unit normally as you would expect, but it would print out I.

D

Guess you want underscore underscore string it print out like a goes class. Is that something that is possible in Esther pie.

D

Hey, because you know you don't want, you know actually want extra whatever, but just don't look at it. But behind that you just want. You know one time, blah blah blah watch for me to swear.

E

In love with this fellowship to enjoy everything a certain class yeah, you still need a conversion function to go the other way, but.

D

As long as you can grab the string, Yeah.

E

D

Oh yeah, you want the conversion, go the other way too. hmm Ok! Well, I.

B

Guess what you I think that, representing a unit in some derivative of what per meter squared cause God knows you could probably do that using after pie, but seeing how we need a function to convert in and out anyway. I get to be fun.

A

D

A strange because this will break our units everywhere, I think now, because.

B

It's still a function that get you getting unit out for you put in unity. It's a string to you function to wait.

G

The more school it's.

B

A quantity to string conversion.

C

What will eat one degree yeah.

D

I guess I would vote for. We accept what is there currently until we work out how we could do this a little bit better with you can if, at.

B

All basket unit the unit handle needs to be both of those functions need to accept or return a quantity. That's all that needs to be for it to satisfying SED yeah.

D

I mean unless, unless somebody says that X to 1.0 is technically a quantity in which case, but it's returning it as a string.

B

It is awful, but it's a string, representation quantity where the Occupy content of class is only a numeric representation of something and a unit.

B

The adverb I quantity is defined as a number and they yield.

D

B

Can only have string representation actually thinking about it, you can only have string representations and units and not as numbers so too might even to make the a petrified quantity to the correct stream representation. Work we'd have to duke / go Albert's goes I, go more than letters units it to make it work even work on what it is. You can't be done. It did the Africa geez. It's not designed to ilysm at all speakers.

H

B

H

They know I agree.

D

With you there, it is crazy and weird that.

H

D

Use goes forth.

D

Yeah, okay, well, I'll give this my plus one. So we can move on.

D

Well, it's not clear how we move I mean this will form the basis of some further thing. If we decide to go with it. Okay, I.

B

Think it w is calling in salts about what we do if it's small of the night I think that none is the correct answer. Did.

E

I leave out yet.

B

Asked as a string how you try again also.

E

D

Already copied out the convention, is you just go a zero pub? Why did you start using floating point?

D

Number. Two. Sorry.

H

D

H

Using floating-point.

D

Floating point for the prefix, so 0.1 a 0.1 is perfectly valid.

D

What hey a 0.1 would be one order of magnitude below a he said: real. Yes, that's a standard I've used it I published papers with that fully.

E

Understand with.

D

C

Sore point one player, shoo.

E

D

C

Wish I will I will do that soon? Yes,.

D

And actually- and you I mean you've- seen the Wizard x, 14 or x, 20 28 x, 28 right that it goes the other way to goes the other way yeah. So that's that's how you extend it. I.

C

Saw somewhere dice also upset, but how you ever seen that no I clear with that said body but I thing like x, 100 was, is define somewhere to be set. I've, never heard of that.

E

Take your crazy.

D

D

So but currently, this function is incorrect because it will take in an x-ray flux when it should take in a unit yeah.

C

That's thus, I have that amazon. I will push it yeah.

B

Daddy, yes and Druse function be.

B

The string input 1 return to quantity, but the reverse doesn't accept. It won't stick.

C

There, it goes in Wikipedia, appeared asset class, but it's a steep if you need so.

D

If you post the link to that.

C

D

Cuz I'm curious.

D

Citation needed Oh.

B

C

That's what I said: ok.

D

Ok, so we move up past on past this topic, yep.

E

H

B

A

It's proof: go yeah.

A

Okay, yep, um so I will give a demo about the Ginga son place on five browser database browser plugin that we have been developing for the past two months as part of google summer of code is hello, yep go ahead, yeah, so, first of all like we can find the plug in here like if we go to the Ginga Sun pie repository of mind, I poke at github.com dajjal hyphen, iit, kgp, /, ginga senpai.

A

There you have to check out my new work branch, go to Ginga hyphen son pie and go to global plugin and to run this app run this plugin. If anyone wants to, he need to copy this file, son pi, dot, B. Why he'll have to go here? First of all, ginger needs to be installed and.

A

Sorry go to your slash home, slash, Ginga, where's, ma Jinga janga create a directory plugins. It would not be there if you haven't created it earlier, create a directory here, have a lot of files here and copy the files, and just here you will need anything else, create a directory plugins inside door Ginga and a copy.

A

This file- son pi 2py in here we will package it and Cheer the functionality that you just need to do: setup, dot, V Y, and then you will be able to all go to go so now, when you have copied that, then you just run Ginga hyphen, hyphen, double hyphen modules, equal to son by the name of the fire.

A

A

Here the Ginga opens and it on the top right corner. You see a tab called Sun pie. This is our database browser, so you provide the database parameter by default. It will show sequel light and it will show Sun 5 DB, and it will create this database by default. If you click connect, it will be attending.

F

A

I would yeah hello share your screen.

F

With you, okay,.

A

Okay, I haven't shared my section.

I

A

Sorry, sorry so I'll start I'll begin from the start. First, we go to my fork of genius and pi2 like at github com, /, Raja life and iit kgp fly ginga dash on fire. Here you check out this branch new work branch inside you. You will find this ginga hyphen Sun pipe like a folder in here. They are twofold, as one is local plugin, the other is global plugin. Initially we started developing the local plugin it is in here.

A

However, we shifted to global, plugin and plan to keep this now for permanent, so this globe will plug in a now contains two files. One is some pie on this cook. You table, we you. This is something I'm working on right now, but this one son pi dot P. Why is the current functional one? So what you will need to do is clone this thing. Take this file, son, pi, dot, py and to run it right now you need to go to your home directory inside.

A

There will be a dot ginga folder go inside the dot ginga folder in here. If you are using it for the first time, there won't be a plugins folder, create a plugins folder and copy the Sun pi dot. Py in here I have a lot of files here. You might not be having them but create this a copy, the Sun pirate py here and to run it. You go to your terminal and you just type Ginga minus minus modules, equal to sun pie for a global plugin.

A

We type modules for a local plugin, we two plugins. So so this one, we are doing modules we will later on package it- and you won't have to do anything to this. You will just have to type ginga minus 15 and it will be good to go so when ginga opens now, it will have a tab called son pie on the top right corner when you click it. You see this. So this thing it has got three frames. One is my database parameters, then these are the options, and then these are.

A

This is one which contains a various action buttons. So these data based parameters it will like, since any database URL. It takes four parameters in sun by the database driver, the database name, the username and the password since a sequin light. Databases won't be needing username and password data for the ones when we make using my sequel opposed is equal, something like that here, which will require a username or password. So by default we will have filled in value sequel light a son by DB. Then we come to these options.

A

There will be one default wavelength which will, by default, be selected as angstrom. We needed this because of some of the files like the ones we got from EIT those needed a default wavelength to be passed along and those fists fits files that we obtained from EIT did not explicitly had default. Wavelength is specified in the fits header. Then you can set the current database as default. It will edit in the conflict, and you can have an option like show starred entries only so. First of all, you fill in these parameters.

A

Click on connect, so I will just click on connect. Here. The database is now connected a sequel light. It's untidy, be you can add file to this database. Click on this a file window opens up. You add some fits files. I'll go ad, say some like I had added files earlier, so I can go around, see view database, but you can go around and add some files here I. This is showing my database as a table.

A

This will have things here where we have different columns, one ID, then the file location, but for SI the file name. Then time start time and instrument wavelength and then, whether it's a start or not, so you, when you click on any of the row, so this file opens up click on the row. Then aia renders right I, don't know why friend it up yeah sake, click on this, then we have the EIT rendering, ok, it is requiring double-click for the proper zooming.

A

You know so that way you see in that there is a functionality that you can star some values, some entries inside the database so like when I click on this say this is not start. So when I click now it is a start so, like I can do something. This, like show only start entries and then I view database. So it is only showing me my start entries here and and.

A

um Do much of that you can open another database like your opener database, so I suppose I've got the Sun by DB here which I was creating, which is evidently the same database. So you can go. Select the Sun pi a cig sa like a sequel light database here, and this will create a URL do that this is n sequel, I'd, slash home, slash modules that Sun pi d, be where I have this location of this but I viewed this database.

A

This one is the same database type selector only the same, a sequel file, but it would have been other suppose you add some file to the database. You go to you go to your fits file, folder where waiters I'm going to use this Sun pipe. The demo sample data folder.

A

Cheers all right so Phi and temple and I take this file, for example, so I view this file now I have got this swap file, but when I close my jingle window, this won't be persistent in my database. So what I need to do is commit this change to the database, so now it will be saved in the database. That's how the database module is developed so that that much one, then these are the top level search boxes where I can a type information and filter out results.

A

This is a in development right now, like if I type, something say I type II. So it's a problem with it is that it is just refreshing, the entire channel- and there is a thing like that- is a 1 development defect that I am working on currently and hopefully it will be fixed within one to two days I. That is what is there in in here in this file.

A

The other son pie, son by Q, table view I have by mistake, used the wrong widget for that thing, so I'm not able to refresh the table so I'm trying to migrate to this new widget. You q table view so hopefully that that will be done and I'll be able to filter inside my database. So.

C

D

Happens over to.

C

The a 3gs, a filtering, the least, that you load before.

A

Sorry do it yeah.

C

We are you like when you search in there in the little box argue requiring. Are you filtering the database itself, or are you just filtering the least that you have on this display I'm.

A

A lake on the top search boxes, they are actually performing a string bass matching only within the column, and then they are filtering it. Based on that, what we have in mind is to develop a separate query interface, which will like take advantage of the query function, that is in the database on Fido database module. But for now it is a. It is just doing a string matching a show function, which yesterday.

D

Street david is doing a string matching function on the numpad.

A

D

A

It on the added.

D

A

No, but the loaded data is the entire database. It's floating everything in the database right.

D

So it it provides you some quick searching that that's why it's so fast. If we were to do if we were to do actual queries on a database, then it's a little bit slower, but what what we're jewel was talking about was to offer you can do more compal, complex queries, using query, database, queries and so he's there will be some some interface to. Let you do that.

C

Cool. Thank you. Yeah.

A

C

D

To the the color tables that.

A

The a big thumb- oh man, don't think that.

B

Involves you have to get that to work you have to both, be you have to boot the Dinka plugin through my wrapper script, which is currently no.

D

Work experience.

B

Has just changed it from a local plug into a global plugin and I haven't made that modification here. So I will repack that and make all the packaging work, and I was just looking at doing it now, for some reason doesn't work on my desktop pcs money to get my laptop, but yeah that's its. Yet it's fine come back.

A

Just reading the database here like we can have the this query interface, we love David, will take advantage of this like this database. Josh query that.

D

Way, you'd be able to filter based on much more complex things and especially there's a lot of information in the and the Fitz headers which are not columns in the database. But the you have the query language then you'd be able to filter. However, you wanted with whatever you know, header values. You wanted. The.

A

B

D

B

A header search relatively simply because it's quite an interesting special case. We could just have a text box somewhere which allows you to do a simple headers, registering search that would be much easier to them and I think probably the full blown query interface will have to be a different project.

B

I, don't think renewal has time to do that, because if we do that properly, we can also use it for we can also, if we do that properly and enable make it work intelligently in a way that I actually searches through the namespaces of the Sun pie package to query what attributes are available to do the search. We can also make basically turn this into a GUI interface for searching all are supported web clients with rich as unified down so I think, potentially next summer, in a follow-on project.

B

To this we can turn this into something really quite flippin awesome using by implementing a graphical representation of our query, language.

B

I think that's probably closer to a whole project on its own, and it is a three-week job.

B

Thanks to you, it's awesome really coming out. Thank you. Good presentation.

D

Is there someone out another student slated to present at this meeting our last time? There's two I: don't.

B

Know what British wants to it, or you want to wait till next week.

A

I'm not exactly ready yet am I well.

B

I mean it works as long as you're assuming go on earth, so you can still show off the API. ugh Forgive.

H

Me wanna, prepare you can do it next week later, but I think it's pretty effective. Oh ok! Ok.

H

We'll do that next week it's what I'm good.

B

There was something.

B

Okay, do we have anything else, anyone wants bring up.

H

B

Okay, we can go see our passion and, if you like, I, am Steve visual time format. Warm done. Oh.

D

My leg is back online: okay,.

E

I wanted to say so much.

D

E

Wish to using anaconda it's good. I think I can now say that we can give up on python XY on windows, side, okay,.

A

B

There is two things that need killing. From that perspective. One is fixing the animals which isn't specific to anna conference pacific for windows, right.

D

B

The other one is: we need to build an open, jpg condo package so that anaconda users on any platform can use our can use. Jpeg 2000.

B

So glimmer are jpeg. 2000 library requires a compiled version of the open, Drabek library, which is a seed library that actually does the jpeg 2000 by own right, because condor is its own isolated environment, including all binaries. We need to write a condom package or open Drabek so that you can use that C library inside Anika.

B

Yeah, that's a good face. Other I appropriate.

B

It's not actually that hard all right I doubt it would be that hard. It's just a case of having all three platforms available to test you on.

B

There is a github repo called condom recipes I just found the and I just found a natural fiber repo.

D

If we're going to do that, why don't we we should have the lump I available in Condor? Yes,.

B

We can, if we're going, to build one package. We can also build a well okay, so this is where it gets more interesting. So we can write a script for we can write. Weeny weeny little need to write a build script for open, jpg glimmer sons and some pop.

B

We can, then, if we had the machines available to do it, we could then build and distribute binary versions of all of those four packages for all supportive and conduct platforms and provide them through twin style, which means that they, the binary versions of those packages, will be installed all on the interviews machine.

B

However, what we would need some kind of build system on all platforms for that to work, because we have to build our own bindings, which we do not advocate ability to do so.

B

The easiest way to do it is because open jpg is a relatively new niche thing is if we provide a recipe for building the package users who wish for it that have the ability to build a condom package themselves locally from source and then can install some fun with the open, jpg stuff available on top.

B

There is this repository of Conda recipes, which contains many a bilks book.

D

Is that the kind of a vessel under a 13 and.

B

They are generally open for Paul Wester, so we can write, build scripts for all our packages and dependencies all of those four packages and submit them to that repo. Well, yeah.

D

B

Then it is a case of a couple of commands for a user to build one of those lectures.

B

But continuum analytics are actually developing a continuous integration system to be attached to pin start, which is there Conda binary distribution platform which would allow people like us to build binaries, save them off in start and their distribute them to people and, however, they have not yet decided whether they're going to make that service free or not.

D

Yeah, ok, then, like a project, if.

B

Someone wishes to take that project on feel free.

G

C

That job is a raise, at least for the next move, some remote button are you building already the list of projects for the summer Google some of those that.

B

Will that's not a google tomiko project, it's it. So we can hack I, just don't have weekends.

C

Okay, put it in the leaf for their Nexus brain.

B

The I am a rapper is a bit more than a weekend weekend project, but that also really does be doing we need. Am we need a.

B

Siphon wizard for that.

D

I imagine we are done with this part or you have anything to say about that. Alberto, uh yes, I. Your original question I think that's ready. My time. Format code is fine.

D

B

And anyone else any opinions on pull request, 1116.

D

Is give me plus lines as well.

C

G

Was going to make.

C

One comment on makes actually goodness at the at the engineer, include any default: I'm video, sorry, honey, there's any default form of yeah.

D

It's a it's in the yeah, it's the default one. What do you mean I know I, wanted a different file.

C

B

How is our working directory built under platforms, the arm linux, other.

D

Dark dump a directory.

B

No, not the dots on my directory see what defaults to home home, /on fight under limit.

H

I, don't you the.

B

Folder is set by the working dir flag in our coffee cup.

C

Is it me or stevia same street from magic.

F

E

Can you hear me now uh what I'm saying was on Windows? It comes out some seed users, ayc gun pod. That's the working directly.

B

D

So is that a specific comment about my my PR or it.

B

Was a general comment with a specific but yeah? It's fine and.

B

He's the puppies are actually dollars.

D

Wait say it again: sorry.

B

It doesn't seem to be a section on our working directory in the documentation on the fifth config file section.

E

Say there's something missing in our documentation: that's not raise it.

D

Yeah I mean this: this PR is not addressing those other kinds of issues.

D

Fortunately, for me, unfortunately, for okay.

B

That's fine, probably spoiled an issue for it, otherwise I'm good, misspoke, fixed any objections, speak now like a whole joke pieces.

D

Yeah, so everyone knows what we're talking about. There is now a time format in the config file. So oh.

G

Yeah, never what's the deep place, it's.

D

uh Also, whatever, without the t, without the tee.

B

D

H

In the middle, no.

D

It's not readable, seen amelie parsed by machines. You do not need the T to know the difference between the date part and the time part. This is meant to be human readable times. Human readable is the only output, yes, only output, only for looking at or humans humans, so easy.

B

Is it usually wear when you save to file no.

D

B

Yeah so he's always only used for printing to screen. That's.

D

Right, that's the point of this default only for human consumption.

G

What what is it Wendy.

B

D

Where do I say this, hopefully I say it's in the config file yeah: it should to be defined in the config file. Yet in a config file, I say this: specifically it's for displaying time and output graphs, for example, and then, when I described it in the dev doc, I do actually don't say anything I, just added some code that says check the dev, the config file. If you're going to need some global config.

B

Okay, well now you can do.

H

D

You I appreciate that.

D

As the were, every all other developers, I've defined, was the whole point of this. Pr is I've defined a time format, a default time format it's in the sump IRC file. If users don't touch it, then that's where it gets red from it's currently, essentially the ISO 80. It's like the fits file, time format, but without the t in between the time of the date, if you are displaying times read in that config and use it, users will be able to customize it to their liking by using their own son IRC file.

D

So that is all this in the hope that we did no, it doesn't and actually well that the trailing said is only if you're in UTC right, which I can't assume that we are in UTC. Yes,.

B

No, yes, everything passed by Eric. There is an implicit assumption that everything passed by pastime is in UTC.

D

B

Very implicitly, but it should be like in 30 days. That is the case, because we have no time because we have no time for Matt Adalind anywhere. The assumption is that it should be in UTC everywhere, so we reserve, for instance, the JSOC light works in thi time, and I added conversion to UTC for everything else. Yeah.

D

Well, I would suggest that that become a larger issue and possibly an SCP about how we handle times in time zones that.

B

That each just assault by using a strip I time right.

D

Which we, which we haven't migrated over to yet not so.

B

That's this. That is probably the biggest reason to move to actually buy time, because you have to find five objects, encapsulate that innovation and deal with all conversions between all the difference that rarest. Oh, oh I, my time is probably a decent budget for next year. Under the level of involvement, the quality yeah.

D

So that the Zed shouldn't be there right now, because, for example, somebody wanted to create a time range in a different time zone. It would currently display with the Zed, regardless of what time zone they were using. Yes,.

B

D

B

Agree that the side.

D

B

My but there is, and I I don't think it search into play, despite the same reason the teacher display, but there is that implicit assumption. Everything in some play is actually in UTC. We should probably talk about something: yes, I.

D

Think we should yeah.

D

Okay, I'm fortunate. I have a one o'clock meeting, so I'm going to have to go. Are there any other questions for me about this or anything else.

B

Don't think so Jack was up next in the firing line. Now he's back come.

D

Like a jack, thank you guys later change.

B

B

Your Jack, your map, you pee on yourself, but you probably know that yeah.

E

H

I can fix that. It's very simple.

F

B

But there are no pull requests here that gone, green and actually can be merged. This is terrible, I.

E

Make the drive either.

B

All that hot Chelle I hereby call this meeting.

B

That's a the one I've early else. They wish to add.

H

H