Wolfram Mathematica

GalAster

02:06

I think that redirect to github release may better

I actually want a Continuous Integration solution that automatically updates the version number, separates and packages the document package and the minimum package, and automatically updates the version number.

I used to write one in the Shell, but I think it can support more complicated settings with high-level languages like NodeJS.

The release page follows some kinds of certain specifications, and your crawler can crawl the latest information and download links.

b3m2a1

04:06

@GalAster interesting... that is something I could conceivably support, but I don't want to necessarily enforce? Also we might be in the same boat, as if we're calling PacletInstall on the release object I'm not sure the download counter gets triggered.

How are you imagining the CI would work? What I mean is it's not exactly trivial to get the version info and such things from the .paclet file.

b3m2a1

05:33

Ugh. There's no good way to get a redirect that PacletInstall can work with.

There only options available are HTML-based methods, but PacletInstall only responds to true server redirects.

b3m2a1

06:08

Here's my current thinking: 1) there's no way to force PacletInstall to redirect on GitHub (it's certainly possible on Wolfram Cloud, but literally no one will ever go to a Wolfram Cloud address I figure). 2) PacletInstall called on the repository paclet asset download URLs do trigger a download logging event

What I imagine I can do is provide the main paclet server on GitHub and mirror the PacletSite.mz onto a ghost paclet server at www.wolframcloud.com/paclets/PacletServer

This ghost server would just provide redirects to GitHub content, either the proper paclet site, if it's not a release URL, or the release asset URL, if that exists.

PacletInstall requests would go to the ghost server. The site and all main content would remain on GitHub (this would also free us from having to duplicate paclets that are already release assets, too).

I am also thinking I'll provide a mechanism to register a webhook from the paclet server to your repo that will automatically open a rebuild request or do a notification in some way like that so that people can just simply add a new release and the build can be automatic-ish.

Now, there are at least 50 pitfalls here, notably a) this uses the Wolfram Cloud which is basically still a beta product b) I don't have a good way to remove myself from this build process at this stage, which is what's necessary to get proper CI

But it's a start and wouldn't be terribly hard to do. @GalAster @Szabolcs what do you think?

b3m2a1

06:47

Omg the cloud is so bad. If I want any short ID I can register the account to [email protected] (even if I don't own that account) then I can "update email" to some email I do own.

And now I have that ID. I just did this because I remembered someone already owned [email protected] so I didn't have user:paclets as a short name.

So I just registered with that email and changed mine.

Kuba

07:19

:)

GalAster

07:59

@b3m2a1 What kind of redirect? Do u mean set the "Location" to a url in PacletSite.mz, or the web site do the redirect

Kuba

Are you fed up with MenuSetup.tr / KeyEvenTranslations.tr customization? Then NotebookActions feature from DevTools` v0.10.0+ (https://github.com/kubaPod/DevTools) is for you! :-p

And seriously, I think it can be quite useful even if in an initial stage. Here's an example: https://mathematica.stackexchange.com/a/184568/5478

GalAster

U can pack ghost Paclet Information in PacletSite.mz in fact, do not have to use automatically generated one.

`"*.paclet"` is a zip, generated by `com.wolfram.paclet.PacletPacker`, but
`"PacletSite.mz"` is a hard-coded compressed package. I don't know how to do it. I often generate corrupted compressed packages.

b3m2a1

08:38

@GalAster I want a proper redirect, so that PacletInstall will follow it

GalAster

Set "Location" also follow.

b3m2a1

Interesting. I didn't know that. That's a pretty easy change, then.

Well I'll still need to maintain some list of redirects to apply to the server list, but that's not too hard.

I think you can also use a PacletSite.m instead of a PacletSite.mz

Which is easily writable

Ah no looks like it enforces .mz

Shame

There's a ...<>"/PacletSite.mz" in the source

GalAster

I will work on CI, vuepress also needs NodeJS, these thing can be done together

b3m2a1

In terms of the packer, I'm pretty sure it's just doing a .zip compression

GalAster

fine, thank you

b3m2a1

08:50

What's your vision for the CI?

KraZug

09:53

:47301373, I've just had an email from Wolfram to ask if I want to make my BVP eigenvalue package available on the FunctionRepository (resources.wolframcloud.com/FunctionRepository)

Although it looks like it isn't really helpful, given that my package has multiple functions that need to interact

Hmm. It looks like my mac version happily overwrites csv files that are already open in Excel (although you don't notice until you close the file and reopen it), but Windows throws an error.

b3m2a1

10:09

@KraZug The function repository is...borderline useful I think. Actually one potential person who could really contribute is @HenrikSchumacher as he has a lot of powerful, standalone functions that only really exist here.

But most useful things aren't one function...

KraZug

10:24

@b3m2a1, yes, I see that. Wolfram sent out an email plugging my package as an advertising email, but attributed it to my former PhD supervisor instead of me. They have now sent out an email correction to the same list, and then they have asked me: "Would you consider adding your functionality to our Function Repository to make it available to a broader audience?"

"We'd like to put you in touch with a co-worker of ours who'd be happy to assist and guide you through the process of adding your functions. ", so I'll see what they come back with.

b3m2a1

Ask them when the paclet repo is coming out :)

3

b3m2a1

10:36

I want to export a string to a subfile in a ZIP file, but have it be interpreted as a package when imported, does anyone know how to do this?

Just for example we can try ExportString[<|"asdasd.txt"->"a[1]"|>, "ZIP"] but I want that .txt file to really be a .m file, but the contents to still be a[1].

Oh nice, nevermind, this is how you do it:

bleh = ExportString[<|{"asdasd.m", "Text"} -> "a[1]"|>, "ZIP"];

ImportString[bleh, {"ZIP", "asdasd.m"}]

a[1]

KraZug

10:51

Yeah, I may well ask that. They have a "Publication Watch Team" - at least that is who I've been communicating with. But they don't seem to blog about it in any way, which would be the best way to actually highlight packages.

KraZug

11:11

Hmm, is there a way to make a safeSave, similar to the safeExport function given here: mathematica.stackexchange.com/questions/75745/…

Kuba

11:25

@KraZug replacing Export with Save does not work because...

?

KraZug

it evaluates the argument

Kuba

@KraZug HoldAll / HoldRest etc?

KraZug

yes, almost certainly a Hold problem

Kuba

I mean, are you aware of those attributes?

Set them for your export function to pass arguments to Save without evaluation.

KraZug

I'm vaguely aware of them yes, but not in practice

list = RandomReal[1, 50];
safeSave[file_String, args___] :=
If[! FileExistsQ[file], Save[file, args], $Failed]
safeSave["test.csv", list]

ok, so SetAttributes[safeSave, HoldRest]

thanks

b3m2a1

12:28

Why do they even provide that shitty Stack Trace feature...it's almost never properly useful and it has a bad tendency to crash the FE.

b3m2a1

12:49

@GalAster bad news: PacletFindRemote calls into PacletManager`Package`setLocation which manually reassigns the location specified in the PacletSite.mz file to wherever they downloaded from.

b3m2a1

13:22

Okay I have a workaround, but rather than purely using PacletInstall it will use a custom function that does a slight override of setLocation. I just tested that it works, so we're good on that.

bobthechemist

13:51

More of a TeX question than M; however, I've got a script with a line Export["out.tex",RandomChoice[list of long text strings],"TexFragment"] that needs to be line-wrapped in order to render properly in LaTeX. Does anyone have any suggestions either in M or LaTeX on how I can get the string to wrap if needed?

Carl Lange

I would say the Function repository is actually quite useful especially in a stack exchange context. There are so many nice functions that only live in answers here and it would be nice to be able to store them somewhere (and update them if it's useful)

GalAster

ResourceFunction["ReadableForm"], I just had a hard time to creat a function like this, LOL.

b3m2a1

14:21

@Szabolcs we can now use the PublicPacletServer interface to install directly from the download URL in your release, provided we're willing to use a function I wrote to overcome some of the hardcoded difficulties in the PacletManager (I've already emailed Todd Gayley about them)

<< paclets.github.io/PacletServer/Install.wl
PublicPacletInstall["IGraphM"]

That will install "IGraphM" from your link, but it uses the PacletServer architecture and everything PacletInstall does for that.

GalAster

@KraZug Would you mind sending me the emails of Wolfram Review Team? I have a lot of neural network models want to submit, but I filled out that table several times and no one contacted me.

b3m2a1

My only changes were to take two of the implementation functions and fix a few bugs

For performance (and also a little bit safety) I'm split the repo into two different repos, too. There's a "Repository" repo which is basically a bare paclet server. We can do all the normal PacletInstall stuff off it. Then there's the PacletServer repo which provides a customized PacletSite.mz file and an install function that respects the "Location" parameter supplied in it.

GalAster

My email is [email protected], help needed

C. E.

14:35

@CarlLange We should have a Github repository for this, I think there was some talk of having that once but it never happened

One big problem is that WRI might at any time add a function with the same name as those in the function repository...

KraZug

14:57

@GalAster, my contacts have been through [email protected]. They sent out a blanket email to advertise my package (very poorly in my opinion, could have explained my package much better if they'd just asked me beforehand). I replied to an email this morning where they suggested putting it on the repository, haven't had a direct contact since.

@GalAster, generally the moderators put email addresses in something like Compress, so it can't be read directly

Szabolcs

@KraZug What is [email protected] ?

@b3m2a1 Thanks! I will test this.

Chris K

15:11

@C.E. Yeah let's do it!

Szabolcs

@b3m2a1 Version 10.0 fun:

Strangely, the Get (instead of Import) fails silently. It just does nothing. No package is actually loaded.

Also, this thing broke my auto-install script too: URLFetch from GitHub releases breaks with the same error.

Is this because GitHub changed certificates?

https from raw.githubusercontent.com does load fine. I was actually trying to make an easier install script before I saw your message.

If I start using this, I would like it to be very very robust though.

Can you get rid of StringEndsQ?

I suggest something like:

If[$VersionNumber > 10.0,
 stringEndsQ = StringEndsQ,
 stringEndsQ[str_, patt_] := StringMatchQ[str, ___ ~~ patt]
]

URLSaveAsynchronous has a nasty habit of failing in some versions on some systems. As I remember, the issues were around 11.0 (+- some), primarily on Windows.

This is why I use URLFetch in my script.

setNonRemoteLocation[paclets:_Paclet,location_String] --> should always use full context, PacletManager`Paclet, or Needs the PacletManager where needed

Sorry, I use URLSave to be precise

I should not that I just skimmed the code, so I only noticed local issues. I should take the time to understand how it works, and which bit runs when. Maybe some of the parts I mentioned above do not actually run.

KraZug