| 11 Apr 2026 |
 hexa | [Tue Apr 7 07:11:07 2026] AMD-Vi: Using global IVHD EFR:0x25bf732fa2295afe, EFR2:0x1d
[Tue Apr 7 07:11:07 2026] pci 0000:c0:00.2: AMD-Vi: IOMMU performance counters supported
[Tue Apr 7 07:11:07 2026] pci 0000:80:00.2: AMD-Vi: IOMMU performance counters supported
[Tue Apr 7 07:11:07 2026] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[Tue Apr 7 07:11:07 2026] pci 0000:40:00.2: AMD-Vi: IOMMU performance counters supported
[Tue Apr 7 07:11:07 2026] AMD-Vi: Extended features (0x25bf732fa2295afe, 0x1d): PPR X2APIC NX GT [5] IA GA PC GA_vAPIC
[Tue Apr 7 07:11:07 2026] AMD-Vi: Interrupt remapping enabled
[Tue Apr 7 07:11:07 2026] AMD-Vi: X2APIC enabled
[Tue Apr 7 07:11:07 2026] AMD-Vi: Virtual APIC enabled
[Tue Apr 7 07:28:55 2026] AMD-Vi: Completion-Wait loop timed out
[Tue Apr 7 12:06:39 2026] AMD-Vi: Completion-Wait loop timed out
[Tue Apr 7 14:33:26 2026] AMD-Vi: Completion-Wait loop timed out
[Tue Apr 7 14:34:09 2026] AMD-Vi: Completion-Wait loop timed out
[Tue Apr 7 15:36:00 2026] AMD-Vi: Completion-Wait loop timed out
[Tue Apr 7 18:11:58 2026] AMD-Vi: Completion-Wait loop timed out
[Tue Apr 7 18:41:58 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 00:39:41 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 01:42:46 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 02:30:06 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 06:51:02 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 06:55:58 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 12:07:31 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 13:03:08 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 14:06:48 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 14:30:59 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 15:52:20 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 15:54:29 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 20:12:38 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 21:17:51 2026] AMD-Vi: Completion-Wait loop timed out
[Wed Apr 8 21:44:14 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 00:19:30 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 00:59:30 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 01:01:57 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 03:28:53 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 07:08:24 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 08:02:55 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 09:10:49 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 10:14:00 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 10:50:43 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 13:21:57 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 13:41:20 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 14:05:22 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 14:53:35 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 15:45:57 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 16:15:29 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 16:16:06 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 16:59:11 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 17:02:36 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 19:24:10 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 23:00:36 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 23:26:18 2026] AMD-Vi: Completion-Wait loop timed out
[Thu Apr 9 23:33:49 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 02:15:21 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 02:32:24 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 03:35:33 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 06:41:22 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 06:47:59 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 07:33:30 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 08:14:39 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 08:55:03 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 09:20:51 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 09:56:58 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 11:30:25 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 12:01:33 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 12:12:48 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 16:56:16 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 18:52:19 2026] AMD-Vi: Completion-Wait loop timed out
[Fri Apr 10 20:29:55 2026] AMD-Vi: Completion-Wait loop timed out
[Sat Apr 11 00:15:14 2026] AMD-Vi: Completion-Wait loop timed out
[Sat Apr 11 01:42:46 2026] AMD-Vi: Completion-Wait loop timed out
[Sat Apr 11 04:44:27 2026] AMD-Vi: Completion-Wait loop timed out
[Sat Apr 11 11:31:24 2026] AMD-Vi: Completion-Wait loop timed out
[Sat Apr 11 11:33:50 2026] AMD-Vi: Completion-Wait loop timed out
| 12:09:37 |
| hexa | something is up with the IOMMU | 12:09:43 |
| hexa | Redacted or Malformed Event | 12:10:12 |
| hexa | well, also visible on the epyc builders | 12:10:29 |
 Jeremy Fleischman (jfly) | how would we notice if this zrepl job started failing? https://github.com/NixOS/infra/blob/main/build/titan/zrepl.nix. i can't find any monitoring/alerting. | 17:53:47 |
| Jeremy Fleischman (jfly) | relevant: https://github.com/NixOS/infra/pull/1004 | 18:03:38 |
| 12 Apr 2026 |
 Arian | In reply to @arianvp:matrix.org
@winter:catgirl.cloud: @winterqt:nixos.dev: i have a time-pressing issue. We enrolled the apple Macs with the MDM Push certificate you created and uploaded. We must renew them within the next 4 days. If we fail to do so the Macs turn into bricks unless we manually unenroll them now.
Could you please today log into Mosyle and follow the instructions with renewing? Or can you share in the infra vault the credentials for winter@nixos.org managed apple id?
This has been fixed. I have reset the Apple account password and did this myself | 09:52:20 |
|  leona changed their profile picture. | 12:15:40 |
 emily | just flagging up: possible that resolution of semantic merge conflict in https://matrix.to/#/!CTCrFzsBPYmDLmrja4:0upti.me/$D5_3aJlWgpCoYwKsCARVLbMCs7eI-wWK1iW2rfKPRyE?via=nixos.org&via=matrix.org&via=tchncs.de to fix NixOS tests might require rebuild of all tests once triaged; not sure if it makes sense to cancel current nixos:unstable builds for now as a result | 16:09:18 |
 ethancedwards8 | I'm getting a 404 error on the unstable branch of search.nixos.org | 20:17:37 |
| ethancedwards8 | 
Download 2026-04-12-161808_1421x226_scrot.png | 20:18:22 |
| hexa | infra has nothing to do with nixos-search | 20:36:17 |
| hexa | https://github.com/NixOS/nixos-search | 20:36:28 |
| hexa | raboof? | 20:36:37 |
 jappie | network tab shows
{"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [latest-45-nixos-unstable]","resource.type":"index_or_alias","resource.id":"latest-45-nixos-unstable","index_uuid":"_na_","index":"latest-45-nixos-unstable"}],"type":"index_not_found_exception","reason":"no such index [latest-45-nixos-unstable]","resource.type":"index_or_alias","resource.id":"latest-45-nixos-unstable","index_uuid":"_na_","index":"latest-45-nixos-unstable"},"status":404}
which is related to this PR yesterday https://github.com/NixOS/nixos-search/pull/1189/changes#diff-a873f4d3cbf7590c99ffb8d3289af09df174091d315d2777cdb1132fc8d30a09
| 20:55:52 |
| hexa | commented on the RP | 20:57:43 |
| hexa | Redacted or Malformed Event | 20:57:45 |
| jappie | ah, and one hour ago here: https://github.com/NixOS/nixos-search/commit/7a259ff093a55bee80e821f7c21a3ea204b87eeb#diff-a873f4d3cbf7590c99ffb8d3289af09df174091d315d2777cdb1132fc8d30a09 (this one updates the frontend version) | 20:58:04 |
| 13 Apr 2026 |
|  Alesya changed their display name from Alesya Huzik to Alesya. | 01:46:58 |
 raboof | thanks for the ping, workaround deployed, tracking the proper fix in https://github.com/NixOS/nixos-search/issues/1197 | 07:10:04 |
 Mic92 | hexa (signing key rotation when): Simon Hauser I started integrating ofborg infra in the nixos infra repo, in the hope that we than have an easier time keeping everything up-to-date: https://github.com/NixOS/infra/pull/1009 | 07:37:13 |
| Mic92 | I also noticed my age keys were not enrolled for these machines | 07:37:40 |
| Mic92 | dgrig: did this happen? https://github.com/NixOS/infra/issues/968 | 08:40:02 |
| hexa | it did | 11:16:38 |
| hexa | https://github.com/FiloSottile/age/issues/537#issuecomment-1907361675
https://github.com/FiloSottile/age/issues/142#issuecomment-1001161195 | 11:27:33 |
| hexa | also https://github.com/str4d/rage/issues/272#issuecomment-2179600832 | 11:30:36 |
 uep | https://hydra.nixos.org/jobset/nixos/unstable shows 4 days since the last eval. I know there were disk space and other issues, as above, but I'm assuming they're now resolved. Is there still an issue? | 22:23:41 |
| uep | Or, as I suddenly realise, is this just awkward timing and rounding - an eval may kick off any minute on the every-2-days schedule, with one having been missed? | 22:24:30 |
| uep | I'll assume it's that for now, there's no real reason to expect an eval to have started immediately after the issue was resolved. | 22:27:13 |
| hexa | dovecot changes caused eval errors | 22:31:20 |
