NixOS CUDA | 315 Members | |
| CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda | 63 Servers |
| Sender | Message | Time |
|---|---|---|
| 20 May 2024 | ||
| Have you seen https://fzakaria.com/2023/09/11/quick-insights-using-sqlelf.html? | 18:17:01 | |
In reply to @tpw_rules:matrix.orgBecause a >200 IQ is necessary to grasp this derivation 😅 | 18:19:34 | |
In reply to @glepage:matrix.orgWhat's the TLDR on why tensorflow is so difficult to package if you don't mind me asking? Maybe this is another example of "packaging is a hard problem" that I can add to my Nix pitch slides. | 18:27:20 | |
| Well, the [tensorflow derivation](https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/tensorflow/default.nix= is ~600 lines of hacking around the bazel build system, + doing a bunch of hacks to inject our own dependencies + CUDA stuff... All of this requires a lot of expertise (that I personnaly lack). It is surely one of the hardest packages that I am aware of in the python package set. | 18:36:24 | |
| * Well, the tensorflow derivation is ~600 lines of hacking around the bazel build system, + doing a bunch of hacks to inject our own dependencies + CUDA stuff... All of this requires a lot of expertise (that I personnaly lack). It is surely one of the hardest packages that I am aware of in the python package set. | 18:36:30 | |
| Now, if you want to take this challenge and update tensorflow, please go ahead. For context, there is a stale PR for updating tensorflow to 2.14: https://github.com/NixOS/nixpkgs/pull/272838 | 18:38:02 | |
In reply to @glepage:matrix.orgI'm already full up with packaging hasktorch haha! Yeah I've had a look at the derivation before and it seems nuts. | 18:49:58 | |
In reply to @connorbaker:matrix.orgI think that's what it is, yeah. This seems to break upon resuming the machine from suspend. | 20:06:08 | |
In reply to @ss:someonex.netI have! I saw Farid give a presentation on it at NixCon NA and that was neat; but it’s not packaged in Nixpkgs and I don’t want to do it :/ | 20:58:45 | |
| does the tensorflow-bin have cuda support? | 21:41:29 | |
| Hmm I guess so | 22:01:54 | |
| It comes with its prebuilt CUDA binary I think | 22:02:11 | |
| 23:23:10 | ||
| 21 May 2024 | ||
| connor (he/him) (UTC-5) where do you "develop" from on nixpkgs ? Do you use the same machine for writting code and building things (i.e. doing eval) ? | 08:04:04 | |
| oh yes, it does, it was easy to set up. thanks all! | 21:08:52 | |
| 22 May 2024 | ||
I use my laptop to ssh into nixos-desktop where I do most of my work | 12:53:43 | |
Ok, I do the same, and then, your nixos-desktop has a few remote builders configured | 12:56:19 | |
| Is it your intel machine that you linked above ? | 12:56:30 | |
| It is | 13:43:13 | |
| Each of the three desktops has the other two as a remote builder so they effectively share the same store, as I understand | 13:43:49 | |
| Ok, thanks so much for answering my questions and providing all those details ! | 14:50:14 | |
| 15:26:09 | ||
| 15:28:22 | ||
| 20:10:22 | ||
| 23 May 2024 | ||
| Ugh finally made some more progress on https://github.com/NixOS/nixpkgs/pull/306172 Hopefully moving now to the “fix other derivations” stage because I’m mostly satisfied with the core logic | 02:36:49 | |
Updated https://gist.github.com/ConnorBaker/305b1aebd7ee74a258a616bbbd4dcd7b with a list of packages which use requireFile if that's helpful to anyone | 13:36:53 | |
| Gaétan Lepage: if you get a chance, could you patch
| 14:28:27 | |
In reply to @connorbaker:matrix.orgSure ! Done: https://github.com/NixOS/nixpkgs/pull/314010 | 14:43:58 | |
| Would you mind also patching https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/svgelements/default.nix? Maybe like the API for the tests changed (extra
| 14:49:59 | |
| Oh there's a patch for it! https://github.com/meerk40t/svgelements/commit/23da98941a94cf1afed39c10750222ccfee73c9f | 14:50:30 | |