!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

464 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.144 Servers

Load older messages


SenderMessageTime
19 Jun 2026
@hexa:lossy.networkhexa
Download
20:33:49
@hexa:lossy.networkhexaI think we're not quite there yet with uploads to s3 🤔20:33:59
@Ericson2314:matrix.orgJohn Ericsonlong term I hope to make us not use the queue runner store entirely21:22:02
@Ericson2314:matrix.orgJohn Ericsoneverything should be binary cache or database21:22:12
@Ericson2314:matrix.orgJohn Ericsonand evaluations should be distributed to builders just like regular build21:22:21
@morwdan:tchncs.demorwdan joined the room.23:16:29
20 Jun 2026
@joerg:thalheim.ioMic92 @hexa:lossy.network: when see a lot of receiving uploads, check also the load on the machine 04:19:38
@joerg:thalheim.ioMic92Because if all CPUs are working, I don't think we can make compression go much faster04:20:17
@joerg:thalheim.ioMic92Yesterday I reduced the number of concurrent uploads a bit again because it was causing issues on some smaller machines. I want to optimise a bit more for stability first before going for maximum throughput04:21:53
@joerg:thalheim.ioMic92* @hexa:lossy.network: when you see a lot of receiving uploads, check also the load on the machine04:22:33
@joerg:thalheim.ioMic92The current upload code for S3 is also not optimal. Usually one should auto scale connections based on what the S3 store respond in terms of error codes04:25:04
@joerg:thalheim.ioMic92I would like to get log and open telemetry collection to work. Than we get more insights04:26:21
@joerg:thalheim.ioMic92* The current upload code for S3 is also not optimal. Usually one should auto scale connections based on what the S3 service respond in terms of error codes04:26:42
@vcunat:matrix.orgVladimír Čunát I wondered why big-parallel builds are in so much trouble since the switch, and apparently we build them with -j1 05:56:57
@vcunat:matrix.orgVladimír ČunátAt least the kernels I see building right now are that way. Some builds do not seem to log the make-parallelism level (e.g. chromium but those I saw now fail due to out-of-disk, as... the temp build space is tmpfs I think)05:59:47
@vcunat:matrix.orgVladimír ČunátYes, firefox here with -j1 as well: https://hydra.nixos.org/log/adgkzznigqcx9zyjaqwldaln30rcqjsg-firefox-beta-unwrapped-151.0b9.drv06:00:19
@joerg:thalheim.ioMic92Okay that's hopefully an easy fix06:00:42
@joerg:thalheim.ioMic92I published my fast-nix-gc fixes I came up when I had to battle with the 1TB nix store / 58GB sqlite nix db: https://github.com/Mic92/fast-nix-gc/pull/4506:04:46
@joerg:thalheim.ioMic92Deploying to staging now06:30:33
@vcunat:matrix.orgVladimír Čunát_I'll be away from a computer for most of today._06:51:05
@vcunat:matrix.orgVladimír Čunát* I'll be away from a computer for most of today.06:51:20
@joerg:thalheim.ioMic92QA passed for the fixes. I will now proceed production hydra.07:08:28
@joerg:thalheim.ioMic92* QA passed for the fixes. I will now proceed with production hydra.07:09:46
@k900:0upti.meK900 Maybe don't 07:09:47
@k900:0upti.meK900 It's been building a kernel for 7 hours 07:09:56
@k900:0upti.meK900We might want to let it finish07:09:57
@joerg:thalheim.ioMic92 K900: build number? 07:10:20
@k900:0upti.meK900 There's a bunch 07:11:49
@k900:0upti.meK900Just search for "linux-" on /status07:12:03
@joerg:thalheim.ioMic92https://hydra.nixos.org/build/331695810/nixlog/1 matches the description07:13:12

Show newer messages


Back to Room ListRoom Version: 6