!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

418 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.128 Servers

Load older messages


SenderMessageTime
15 May 2026
@hexa:lossy.networkhexa (signing key rotation when)https://photon.codes/blog/we-found-a-ticking-time-bomb-in-macos-tcp-networking 🤷10:27:29
@hexa:lossy.networkhexa (signing key rotation when)yeah, no. it does repro.10:29:22
@hexa:lossy.networkhexa (signing key rotation when)rebooting10:31:32
@hexa:lossy.networkhexa (signing key rotation when)excessive swapping fixed
Download excessive swapping fixed
10:36:26
@hexa:lossy.networkhexa (signing key rotation when)and disk space recovery too
Download and disk space recovery too
10:37:26
@hexa:lossy.networkhexa (signing key rotation when)the outliers are the ofborg macs, which provide a good comparison10:37:36
16 May 2026
@vcunat:matrix.orgvcunat

I now canceled the rest of the last nixos-unstable eval in order to make that channel move. Again.

The critical set has passed and all packages get cached via a nixpkgs eval on the exactly same commit. The problem is that those thousands of other jobs would probably take Hydra lots of time to complete (I'd estimate a day or two of work), slowing other important stuff - like the NixOS 26.05 release consequently, probably. And completing them wouldn't bring singificant value, I believe.

13:38:33
@emilazy:matrix.orgemilynon-channel-blocking NixOS tests?13:41:58
@vcunat:matrix.orgvcunatYes, that's the main part which will be missing on that eval.13:42:28
@emilazy:matrix.orgemily IMO, we should consider if building all of those on Hydra really makes sense. there's no notification when they regress. if they're for package maintainers they can be passthru.tests that Hydra ignores 13:42:57
@emilazy:matrix.orgemilysome of them should probably be blocking, but spending a lot of time building the rest seems questionable?13:43:21
@vcunat:matrix.orgvcunatThe current price/value ratio isn't great. I agree with that.13:43:57
@emilazy:matrix.orgemilyespecially in a world where we'd like to be shipping kernel updates faster...13:44:06
@vcunat:matrix.orgvcunatMaybe the new queue-runner will change that significantly. No idea, maybe I'm just too optimistic. 13:44:12
@vcunat:matrix.orgvcunat* Maybe the new queue-runner will change the price significantly. No idea, maybe I'm just too optimistic. 13:44:20
@emilazy:matrix.orgemilyI'd guess it's a lot of raw CPU time for the actual tests too? 🤔13:46:31
@emilazy:matrix.orgemilyI'll try to at least work on the "no separate NixOS and Nixpkgs jobset" thing after branch off, which might alleviate the "duplicate scheduling or build work between the two" problem... maybe we can cut out non-blocking tests for now at the same time13:48:08
@vcunat:matrix.orgvcunatThe raw CPU time is minority here. I'm quite sure.13:51:36
@vcunat:matrix.orgvcunatIt's mainly building loads of tiny .drv (for /etc), loads of cheap huge .drv (disk-image whatever), etc. Moving them there and back, compressing, to S3. Lots of delays which you will not notice when running a NixOS test locally.13:53:02
@emilazy:matrix.orgemilyright13:53:20
@vcunat:matrix.orgvcunatAt least that's what it looks like from my years-long observation of what Hydra is doing.13:53:23
@emilazy:matrix.orgemily...the disk images probably aren't great for cache growth either though :)13:53:36
@vcunat:matrix.orgvcunatWith a good GC strategy that might not be a problem (in future).13:53:58
@vcunat:matrix.orgvcunat* With a good GC strategy for S3 that might not be a problem (in future).13:54:09
@emilazy:matrix.orgemily yeah.... mostly I'm just sceptical that non-blocking tests get much consumption from Hydra anyway. package bumps, spot-checking if functionality is working, people including them in their configs for bonus assurance - Hydra building them is pretty extraneous 13:57:01
@emilazy:matrix.orgemilythe main case I can imagine them providing value is notification when they break. but uh, haven't seen much evidence that any maintainer is proactively checking when their stuff breaks, so probably a bigger deal to establish that norm for packages first. and anyone going to the trouble of setting up a notification system can probably spare the cycles to build the test13:58:16
@vcunat:matrix.orgvcunatA nice way to follow failures for particular jobs (packages/tests) would be a useful improvement, though that's tangential here.14:02:06
@emilazy:matrix.orgemilyyeah, I agree. I'm very much in favour of better notifications and delegating work to maintainers14:04:50
@emilazy:matrix.orgemilybut I'm guessing that even adding "every test anyone active is interested in following" back in would be relatively little 😅14:05:12
@emilazy:matrix.orgemilyI mean, it would be really nice if we could cut staging-nixos out of the process again.14:06:00

Show newer messages


Back to Room ListRoom Version: 6