!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

293 Members
63 Servers

Load older messages


SenderMessageTime
24 Apr 2024
@gibbs_ensamble:matrix.org@gibbs_ensamble:matrix.org left the room.21:16:41
25 Apr 2024
@ss:someonex.netSomeoneSerge (hash-versioned python modules when) changed their display name from SomeoneSerge (void) to SomeoneSerge (UTC+1).23:01:13
26 Apr 2024
@brodriguesco:matrix.orgBruno Rodrigues changed their profile picture.09:19:24
27 Apr 2024
@ygt:matrix.org@ygt:matrix.org joined the room.18:21:19
29 Apr 2024
@anjoletto:matrix.org@anjoletto:matrix.org joined the room.01:46:16
@ss:someonex.netSomeoneSerge (hash-versioned python modules when) changed their display name from SomeoneSerge (UTC+1) to SomeoneSerge (is taking time off and doesn't want to hear about it).11:43:13
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.15:29:11
30 Apr 2024
@xondtx:matrix.orgondt joined the room.22:18:47
1 May 2024
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.15:06:23
@daschw:matrix.org@daschw:matrix.org joined the room.18:52:42
3 May 2024
@kyaru:ptt.moe@kyaru:ptt.moe joined the room.19:24:03
4 May 2024
@ss:someonex.netSomeoneSerge (hash-versioned python modules when) changed their display name from SomeoneSerge (is taking time off and doesn't want to hear about it) to SomeoneSerge (Way down Hadestown).21:03:47
5 May 2024
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.org joined the room.06:55:04
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.orgSorry in advance if my question doesn't fit in here. I would like to build a CI workflow for reproducible academic work. Basically the main document, written in LaTeX includes certain plots, which would be costly to recreate on every run. Hence, the workflow should recreate those only if the code that produced them changed. Similarly, the LaTeX should only be recompiled if the actual figures changed (as not all code changes would lead to different figures). Is it difficult to build such CI workflows?06:59:27
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.org * Sorry in advance if my question doesn't fit in here. I would like to build a CI workflow for reproducible academic work. Basically the main document, written in LaTeX includes certain plots, which would be costly to recreate on every run. Hence, the workflow should recreate those only if the code that produced them changed. Similarly, the LaTeX should only be recompiled if the actual figures changed (as not all code changes would lead to different figures). Is it difficult to build such CI workflows? (nor sure if it matters too much, but code is written in Julia)06:59:57
@brodriguesco:matrix.orgBruno RodriguesI do something like that using R but I rebuild the whole thing as there's no computation involved 15:02:04
@brodriguesco:matrix.orgBruno Rodrigueshere's a demo https://github.com/b-rodrigues/render_quarto_test 15:02:12
@brodriguesco:matrix.orgBruno Rodriguesbut if I only wanted to rebuild parts of it, I'd use targets instead of calling quarto directly 15:03:13
@brodriguesco:matrix.orgBruno RodriguesAlso, this uses a quarto markdown source document, but you can just as well use Latex 15:03:52
@gtrunsec:matrix.orgguangtaohttps://github.com/hardenedlinux/AISecurity-Research-Template15:24:07
@gtrunsec:matrix.orgguangtaoquarto+jupyenv+drvparts+dream2nix+std example heee15:24:57
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.orgThanks for sharing your templates. While I can definitely learn something from each of them, I am still wondering how I could compile the plots if the code changed and compile the LaTeX if the TeX code or the plots changed.17:34:27
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.orgI am thinking if this is something that should be done with Nix. Maybe not since Nix puts everything it builds into the Store, right?17:35:44
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.orgIsn't this a problem that comes up eg with monorepos? isn't there are simple solution then?17:36:44
@gtrunsec:matrix.orgguangtao
In reply to @markus.lohmayer:matrix.org
Thanks for sharing your templates. While I can definitely learn something from each of them, I am still wondering how I could compile the plots if the code changed and compile the LaTeX if the TeX code or the plots changed.
I don't really understand your motivation. if the plots changed just quarto rebuild the qmd dir, that's all
17:56:04
@gtrunsec:matrix.orgguangtaonix only used to build and control the kernels' generatation17:56:38
@gtrunsec:matrix.orgguangtaoalso there is no reason to exec 'quarto build' inside the nix store17:57:46
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.orgOK, I don't know quarto, that's the point. but it sounds like it is doing what I need. I will have a look18:21:48
@markus.lohmayer:matrix.org@markus.lohmayer:matrix.orgOk, I already stated that I am stuck with LaTeX, so suggesting quarto, as I understand by looking at quatro.org, is not helpful.18:26:47
@jb:vk3.wtfjbedo fetchurl and fetchgit have postFetch which you could use to extract the paper/figure code 22:10:11

Show newer messages


Back to Room ListRoom Version: 6