13 Aug 2024 |
connor (he/him) (UTC-7) | SomeoneSerge (UTC+3): I haven't had a chance to follow super closely, but for the aarch64-builders, do we have anything for CI beside the Hetzner instance I have? I'm trying to cut down on cloud infra I pay for so I can pay for my electricity bill (which is an order of magnitude more than I had budgeted for) | 05:25:13 |
connor (he/him) (UTC-7) | I'm not sure what the status of CUDA packages on the NixOS-community hydra is | 05:25:30 |
| @accipiterx:matrix.org left the room. | 06:03:35 |
| @ironbound:hackerspace.pl set a profile picture. | 07:58:42 |
SomeoneSerge (utc+3) | In reply to @connorbaker:matrix.org SomeoneSerge (UTC+3): I haven't had a chance to follow super closely, but for the aarch64-builders, do we have anything for CI beside the Hetzner instance I have? I'm trying to cut down on cloud infra I pay for so I can pay for my electricity bill (which is an order of magnitude more than I had budgeted for) I think I disabled qemu because it was going out if proportion, so no. Disable howevermany jobsets you feel is necessary. Kill all the builders if it comes to.
I saw the community Hydra was recently merged a PR recovering the jobset, I think they're now trying it with limited parallelism | 08:16:21 |
SomeoneSerge (utc+3) |
electricity bill ... order of magnitude higher
Oof, how does that happen. I've hit a ~4x in the winter once but because I'm bad at reading contracts, not because of infra... | 08:20:17 |
connor (he/him) (UTC-7) | Infra is just something I pay out of pocket for (it’s in the cloud so it’s not the electricity use I’m concerned about); I just need that money for my electricity bill lmao | 15:25:21 |
connor (he/him) (UTC-7) | In reply to @ss:someonex.net
electricity bill ... order of magnitude higher
Oof, how does that happen. I've hit a ~4x in the winter once but because I'm bad at reading contracts, not because of infra... My electricity provider in California has surge pricing during peak hours, a base fee per day, and higher rates than what I had in Virginia so I’m quickly learning I need to live with the windows open and AC off lmao | 15:26:13 |
14 Aug 2024 |
| peddie changed their profile picture. | 00:34:49 |
| caniko joined the room. | 18:33:39 |
caniko | Hello, nix is still building cuda even though I setup cuda-maintainers. | 18:34:24 |
caniko | I am on nixos, and using flakes | 18:34:32 |
caniko | nix.settings = {
substituters = [
"https://cuda-maintainers.cachix.org"
];
trusted-public-keys = [
"cuda-maintainers.cachix.org-1:0dq3bujKpuEPMCX6U4WylrUDZ9JyUG0VpVZa7CNfq5E="
];
};
# nixpkgs.config.cudaSupport = true;
}```
| 18:34:52 |
caniko | I had to comment it out... | 18:35:08 |
SomeoneSerge (utc+3) | In reply to @caniko:matrix.org Hello, nix is still building cuda even though I setup cuda-maintainers. This must mean that your particular revision wasn't cached | 18:37:41 |
caniko | In reply to @ss:someonex.net This must mean that your particular revision wasn't cached I didn't select a version 🤪 | 18:38:11 |
caniko | how do I do that? and what is latest? | 18:38:22 |
caniko | Redacted or Malformed Event | 18:38:30 |
caniko | * how do I do that? and what is latest on cache? | 18:38:40 |
caniko | * how do I do that? and what is latest on cache? Can I do it so that I am always on latest? | 18:38:51 |
SomeoneSerge (utc+3) | The last I see in the logs is https://github.com/SomeoneSerge/nixpkgs-cuda-ci/commit/997229a3acb24e73898da3286a2e0caeb81bc918#diff-216b2b7bfde9416c79d133bacb031e95702a20bdedb548c0b055c837aa4f6a9cR68
The maintainers' cache is in a low maintenance mode right now. If you're willing you can try the nix-community cachix, but please note that their cuda jobset isn't officially stabilized yet and can be pulled out at any moment. Both caches are provided with out any obligations, etc, etc, etc | 18:43:53 |
SomeoneSerge (utc+3) | caniko^ | 18:44:16 |
caniko | In reply to @ss:someonex.net The last I see in the logs is https://github.com/SomeoneSerge/nixpkgs-cuda-ci/commit/997229a3acb24e73898da3286a2e0caeb81bc918#diff-216b2b7bfde9416c79d133bacb031e95702a20bdedb548c0b055c837aa4f6a9cR68
The maintainers' cache is in a low maintenance mode right now. If you're willing you can try the nix-community cachix, but please note that their cuda jobset isn't officially stabilized yet and can be pulled out at any moment. Both caches are provided with out any obligations, etc, etc, etc Thanks; however, I actually don't know how to use this | 19:10:21 |
SomeoneSerge (utc+3) | Something like nix flake lock --update-input nixpkgs github:NixOS/nixpkgs/$commitid if I'm not mistaken | 19:11:09 |
SomeoneSerge (utc+3) | or is it nix flake update --update-input ? | 19:11:23 |
caniko | but will nix flake update --update-input automatically start using cachix? | 19:14:44 |
SomeoneSerge (utc+3) | This is unrelated to cachix, this just pins a different nixpkgs version. When nix "builds" a derivation it looks at whether its inputs are available, and if not it builds or substitutes them, recursively. Which substituters to use (including cachix) is a global nix configuration. | 19:19:35 |
SomeoneSerge (utc+3) | So if you pick a particular nixpkgs commit and look at its pytorch, it'll correspond to a hash, and if the substituter (cachix) says it knows this hash you'll end up downloading the prebuilt thing instead of running the expensive build | 19:20:33 |
| kaya changed their profile picture. | 19:52:20 |
| chikyuukaiten joined the room. | 20:03:50 |