!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

325 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
16 Nov 2022
@omlet:matrix.orgomlet joined the room.20:34:15
23 Nov 2022
@skainswo:matrix.orgSamuel Ainsworth
In reply to @breakds:matrix.org
A separate question, as I read from https://discourse.nixos.org/t/announcing-the-nixos-cuda-maintainers-team-and-a-call-for-maintainers/18074 , is x86_64-linux computing cycle still needed for github actions? I have a spare RTX 3080 not attached to any machine at this moment, not sure what is the best way to make it useful to the project. Shall I build a machine to run github actions?
Hi breakds! Thanks so much for your generosity! Yes, we'd love to find a way to make it useful somehow. Oddly enough our primary bottleneck atm is CPU cycles. It turns out that running CIs (nixpkgs-upkeep, Someone S 's build CI) takes a bit of compute. I'm finding that build jobs frequently hit the free-tier 6 hour limit on GH Actions, so finding an x86_64-linux machine that could be home to a GH Actions runner would be great!
09:11:05
@skainswo:matrix.orgSamuel AinsworthI created https://github.com/samuela/nixpkgs-upkeep with the goal of ultimately running GPU-enabled tests in CI, but honestly we've had so many issues just keeping the packages building at all (only CPU required to build), that GPU-enabled tests haven't been the issue so far09:12:34
@skainswo:matrix.orgSamuel Ainsworth and of course Someone S may have other needs as well 09:13:19
@skainswo:matrix.orgSamuel Ainsworth on the caching side, Domen Kožar has been incredibly helpful with the cuda-maintainers cache on Cachix (https://app.cachix.org/cache/cuda-maintainers#pull)! A lot of folks have him to thank for their setups working smoothly! 09:15:04
@omlet:matrix.orgomlet left the room.20:30:38
25 Nov 2022
@darthpjb:matrix.orgJohn Bargman joined the room.03:09:16
@skainswo:matrix.orgSamuel Ainsworthanyone have any feature requests for GitHub? https://discourse.nixos.org/t/nixos-github-collaboration/2343206:52:51
@tpw_rules:matrix.orgtpw_rulesimproved caching would be great. there have been some bugs there in the github actions that are ugly to work around and they would not fix15:31:53
@tpw_rules:matrix.orgtpw_rulesalso particularly for us, figuring out how to get cuda and stuff to work nicely in codespaces. (are nvidia codespaces includes in the free hours/)15:32:27
@tpw_rules:matrix.orgtpw_rules * also particularly for us, figuring out how to get cuda and stuff to work nicely in codespaces. (are nvidia codespaces includes in the free hours?)15:32:29
@skainswo:matrix.orgSamuel AinsworthI'm not sure I understand... do you have concrete examples of these caching failures? what could GitHub do to help the situation?19:29:17
@skainswo:matrix.orgSamuel Ainsworthyeah having a free GPU in codespaces would be nice! unfortunately I imagine that would also be quite pricey for them19:29:51
@ss:someonex.netSomeoneSerge (matrix works sometimes)Oh, not at all. Just that I don't think I had even one PR accepted without someone asking me to specify the platforms explicitly 🤣 But it also makes sense: the attribute is treated specially by hydra (and probably other CIs), so why leave it implicit21:32:51
@ss:someonex.netSomeoneSerge (matrix works sometimes)"Caching" was my first thought as well, but probably we're talking about different caches. It's always about caching though21:34:22
@ss:someonex.netSomeoneSerge (matrix works sometimes) Does anyone feel like following through with the 11.7 -> 11.8 bump? There were some packages with cmake configure failing =\ 21:35:48
@tpw_rules:matrix.orgtpw_rules
In reply to @skainswo:matrix.org
I'm not sure I understand... do you have concrete examples of these caching failures? what could GitHub do to help the situation?
it's not possible to naïvely cache the store using the cache action because it can't restore the read only files. i'm not sure why they can't just extract the archive with sudo or whatever. it's work-around-able by manually changing permissions and shuffling stuff around but that's slow
22:37:16
26 Nov 2022
@skainswo:matrix.orgSamuel Ainsworthahhhhhh I see. sounds a bit like https://github.com/NixOS/nixos-foundation/issues/25#issuecomment-132789224300:01:04
@skainswo:matrix.orgSamuel Ainsworthyeah, agreed that would be helpful00:01:14
@tpw_rules:matrix.orgtpw_rulesyes. i'm not even clamoring for a global cache, i really just want the cache action to work nicely00:06:10
@tpw_rules:matrix.orgtpw_rulesthough a global cache would be great00:06:18
@tpw_rules:matrix.orgtpw_rules * though a global cache would be great. but fixing the cache action should be a very easy target00:06:36
@tpw_rules:matrix.orgtpw_rulesi commented on that thread, thanks for pointing me to it00:09:09
@hexa:lossy.networkhexahttps://github.com/NixOS/nixpkgs/pull/20276916:56:54
@hexa:lossy.networkhexacan someone review this?16:56:59
@hexa:lossy.networkhexaworking on torchaudio and it would be neat to have this16:57:15
@ahsmha:matrix.orgahmed changed their display name from rh to ahmed.19:19:35
29 Nov 2022
@tpw_rules:matrix.orgtpw_rules hexa: running a nixpkgs-review cycle including CUDA stuff. planning to try the test suite too. expect something by tomorrow evening but i don't expect any major issues 05:05:55
@tpw_rules:matrix.orgtpw_rulesthank you for your patience05:06:53
@skainswo:matrix.orgSamuel Ainsworthdraft CUDA 11.8 upgrade: https://github.com/NixOS/nixpkgs/pull/20365820:49:35

Show newer messages


Back to Room ListRoom Version: 9