!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

387 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.118 Servers

Load older messages


SenderMessageTime
8 Apr 2025
@Ericson2314:matrix.orgJohn Ericsonohhh17:14:41
@Ericson2314:matrix.orgJohn EricsonI got confused by commit date vs author date17:14:51
@Ericson2314:matrix.orgJohn Ericsonit didn't land until end of last year17:14:55
@emilazy:matrix.orgemilyprobably no point working on the old implementation that only has a couple months to live17:18:45
@emilazy:matrix.orgemilyjust overlay the new one maybe?17:18:57
@Ericson2314:matrix.orgJohn Ericsonyeah17:31:01
@Ericson2314:matrix.orgJohn Ericson hexa (signing key rotation when): can't push so instead I'll paste a comment 17:31:10
@Ericson2314:matrix.orgJohn Ericsonhttps://github.com/NixOS/infra/pull/620#issuecomment-278718469117:31:58
@hexa:lossy.networkhexa John Ericson: the queue-runner status does not expose the machine dict anymore 21:24:07
@Ericson2314:matrix.orgJohn Ericson hexa (signing key rotation when): this is a UI bug? 21:24:45
@hexa:lossy.networkhexa09a1e64ed2d16ffbbcbc0c98458c621f5d939cf0 hm21:25:02
@hexa:lossy.networkhexahttps://github.com/NixOS/infra/blob/main/build/pluto/prometheus/exporters/hydra-queue-runner-reexporter.py#L56921:25:56
@hexa:lossy.networkhexawe query it here21:25:57
@hexa:lossy.networkhexawondering what we do with the machine infos 😄 21:26:55
@hexa:lossy.networkhexadropping the machine collector to find out21:30:02
@Ericson2314:matrix.orgJohn Ericsonhuh OK21:34:07
@Ericson2314:matrix.orgJohn Ericsonthe code in hydra to render them is still here21:34:16
@hexa:lossy.networkhexahm, waiting for the queue-runner to queue builds 🤔21:38:00
@Ericson2314:matrix.orgJohn Ericson hexa (signing key rotation when): https://github.com/NixOS/hydra/pull/1471 doesn't solve the problem 21:39:32
@Ericson2314:matrix.orgJohn Ericsonbut should at least make it a bit less weird21:39:37
@hexa:lossy.networkhexahttps://grafana.nixos.org/d/MJw9PcAiz/hydra-jobs?orgId=1&from=now-1h&to=now&timezone=browser&var-machine=$__all21:40:41
@hexa:lossy.networkhexahrm, runnables go up, but nothing gets run21:40:49
@hexa:lossy.networkhexaso it not showing any machines might be related to it not running any builds 😕 21:42:38
@hexa:lossy.networkhexaaka the queue-runner does not know the machines21:42:53
@Ericson2314:matrix.orgJohn Ericsonyes it would appear the queue runner thinks there are no machines21:44:07
@Ericson2314:matrix.orgJohn EricsonI have to go in 15 minutes for a few hours, so definitely feel free to roll back21:44:30
@hexa:lossy.networkhexaApr 08 21:02:07 mimas hydra-queue-runner[2098869]: reloading machines file: error: bad machine specification: failed to convert column #3 in a row: ' no route even now' to 'unsigned int' 21:47:45
@hexa:lossy.networkhexa
### MacStadium machines
# (currently all 5 are allocated to ofborg.)

### Hetzner Linux builders
build@elated-minsky.builder.nixos.org x86_64-linux,i686-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 32 4 kvm,nixos-test,benchmark - -
build@sleepy-brown.builder.nixos.org x86_64-linux,i686-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 4 kvm,nixos-test,big-parallel big-parallel -
build@sleepy-brown.builder.nixos.org x86_64-linux,i686-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 8 4 kvm,nixos-test,big-parallel - -

build@goofy-hopcroft.builder.nixos.org aarch64-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 40 4 kvm,nixos-test - -
root@135.181.230.86 aarch64-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 5 1 kvm,nixos-test,big-parallel big-parallel -
root@135.181.230.86 aarch64-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 1 kvm,nixos-test,big-parallel - -

### Hetzner macs
root@sweeping-filly.mac.nixos.org x86_64-darwin,aarch64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 2 -
root@maximum-snail.mac.nixos.org x86_64-darwin,aarch64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 2 -
root@growing-jennet.mac.nixos.org x86_64-darwin,aarch64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 2 -
root@enormous-catfish.mac.nixos.org x86_64-darwin,aarch64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 2 -
root@intense-heron.mac.nixos.org x86_64-darwin,aarch64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 2 -

### foundation machines hosted by detsys in PSF1
### 2024-12-16 prepared to be shipped to new location
#root@quality-ram.foundation.detsys.dev aarch64-darwin,x86_64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 1 big-parallel
# 2024-12-08 tight-bug only provides aarch64-darwin capacity, cole poked
#root@tight-bug.foundation.detsys.dev aarch64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 1 big-parallel
#root@becoming-hyena.foundation.detsys.dev aarch64-darwin,x86_64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 1 big-parallel

#root@cosmic-stud.foundation.detsys.dev aarch64-darwin,x86_64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 2 big-parallel
# testing apple-virt, PR #303597.  Doesn't work, but at least it consumes those jobs instead of them rotting in the queue :-(
##root@cosmic-stud.foundation.detsys.dev aarch64-darwin,x86_64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 1 big-parallel,nixos-test,apple-virt

# dropped; no route even now
#root@destined-gannet.foundation.detsys.dev x86_64-darwin /var/lib/hydra/queue-runner/.ssh/id_ed25519 4 2 big-parallel

### oakhost macs
root@eager-heisenberg.mac.nixos.org aarch64-darwin,x86_64-darwin /var/lib/hydra-queue-runner/.ssh/id_ed25519 2 3 big-parallel
root@kind-lumiere.mac.nixos.org aarch64-darwin,x86_64-darwin /var/lib/hydra-queue-runner/.ssh/id_ed25519 2 3 big-parallel

### Vladimir's machines
#root@t2a.cunat.cz i686-linux,x86_64-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 1 kvm,nixos-test benchmark
#root@t4b.cunat.cz x86_64-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 1 1 kvm,nixos-test,big-parallel big-parallel
#root@t4b.cunat.cz x86_64-linux /var/lib/hydra/queue-runner/.ssh/id_ed25519 6 1 kvm,nixos-test
21:48:34
@hexa:lossy.networkhexaL3121:49:02
@hexa:lossy.networkhexadropping the semicolon made it work again21:51:01

Show newer messages


Back to Room ListRoom Version: 6