!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

384 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.115 Servers

Load older messages


SenderMessageTime
2 Mar 2026
@awoobabyglowup9888:matrix.orgFlint W. joined the room.20:39:15
3 Mar 2026
@genericnerdyusername:matrix.org@genericnerdyusername:matrix.org left the room.00:18:47
4 Mar 2026
@nam3l33ss:matrix.org·☽•Nameless☆•777 · ± changed their profile picture.03:11:27
@yaya:uwu.isyaya joined the room.14:37:03
@yaya:uwu.isyaya Hi, I'll be the new release manager for NixOS 26.05 and would like to request restart-jobs, bump-to-front and cancel-build privileges on my hydra account (github@uwu.is) 14:40:50
@vcunat:matrix.orgvcunat Awarded. Also eval-jobset. 15:43:06
5 Mar 2026
@dgrig:erethon.comdgrig Mic92: https://github.com/NixOS/infra/issues/968 (cc'ing hexa (signing key rotation when) as discussed in the infra sync) 17:42:48
6 Mar 2026
@hsngrmpf:matrix.orgDavHau joined the room.15:22:20
@hsngrmpf:matrix.orgDavHauI wanted to report this since some time, but didn't get around to do it. cache.nixos.org is consistently very very slow (down to 200 Kb/s) in Thailand. https://discourse.nixos.org/t/download-speed-in-nixos-update-is-too-slow/68138/6?u=davhau Please let me know if I can help with debugging this. I am pulling +110 Mb/s from other CDNs, so it is not an issue with my setup. It is liekly that other people in asia are experiencing this as well and if so then it is a real adoption blocker for nixos in asia.15:26:50
@hsngrmpf:matrix.orgDavHau* I wanted to report this since some time, but didn't get around to do it. cache.nixos.org is consistently very very slow (down to 200 Kb/s) in Thailand. https://discourse.nixos.org/t/download-speed-in-nixos-update-is-too-slow/68138/6?u=davhau Please let me know if I can help with debugging this. I am pulling +110 Mb/s from other CDNs, so it is not an issue with my setup. It is likely that other people in asia are experiencing this as well and if so then it is a real adoption blocker for nixos in asia.15:27:14
@hsngrmpf:matrix.orgDavHau(My provider is AIS which is one of the main ones in the region AFAIK)15:28:47
@hexa:lossy.networkhexa (signing key rotation when)what is your path to cache.nixos.org?16:43:09
@hexa:lossy.networkhexa (signing key rotation when)per https://www.fastly.com/network-map there should be a pop in bangkok16:43:44
@ctheune:matrix.flyingcircus.ioTheuni changed their display name from Christian Theune to Theuni.19:58:06
7 Mar 2026
@hsngrmpf:matrix.orgDavHau
[nix-shell:~]# mtr --report cache.nixos.org
Start: 2026-03-07T13:31:01+0000
HOST: bam                         Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- console.gl-inet.com        0.0%    10    0.5   0.6   0.5   1.0   0.2
  2.|-- 192.168.1.1                0.0%    10    1.1   1.8   1.0   7.7   2.1
  3.|-- 100.67.0.1                 0.0%    10    2.7   3.0   2.6   3.3   0.3
  4.|-- ae8.fcr01j.tls1.myaisfibr  0.0%    10   12.8  22.3  12.1  32.3   7.9
  5.|-- ve474.cgn05.tls1.myaisfib  0.0%    10   12.0  12.1  11.8  12.8   0.3
  6.|-- ae23.bgw01j.tls1.myaisfib  0.0%    10   13.6  16.2  12.4  44.0   9.8
  7.|-- 49-228-5-0.24.tls1.myaisf 70.0%    10   12.7  12.7  12.2  13.1   0.4
  8.|-- ???                       100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- 119.31.4.123               0.0%    10   39.8  40.0  39.6  40.5   0.3
 10.|-- 151.101.193.91             0.0%    10   14.3  13.9  13.4  14.3   0.3

[nix-shell:~]# mtr -6 --report cache.nixos.org
Start: 2026-03-07T13:31:22+0000
HOST: bam                         Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- GL-MT3000.lan              0.0%    10    0.6   0.7   0.5   0.9   0.2
  2.|-- 2405-9800-b900.44.pool1.c  0.0%    10    1.5   1.4   1.3   1.6   0.1
  3.|-- 2405:9800:70::5            0.0%    10    3.0   2.7   2.2   3.2   0.3
  4.|-- 2405:9800:b005:96::97      0.0%    10   12.3  13.3  11.7  21.9   3.1
  5.|-- 2405:9800:b005:100::100    0.0%    10   12.6  13.4  12.0  21.4   2.8
  6.|-- 2405:9800:b005:118::118    0.0%    10   12.1  12.2  11.6  12.9   0.4
  7.|-- 2405:9800:9802::32e        0.0%    10   14.2  14.8  14.2  15.3   0.3
  8.|-- 2405:9800:9802::31c        0.0%    10   42.9  42.8  42.3  43.2   0.3
  9.|-- 2a04:4e42:200::347         0.0%    10   13.5  13.8  13.3  14.4   0.3

hexa (signing key rotation when)

13:32:07
@hsngrmpf:matrix.orgDavHau *
[nix-shell:~]# mtr --report-wide cache.nixos.org
Start: 2026-03-07T13:33:24+0000
HOST: bam                               Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- console.gl-inet.com                0.0%    10    0.5   0.6   0.5   0.8   0.1
  2.|-- 192.168.1.1                        0.0%    10    1.6   1.2   1.1   1.6   0.1
  3.|-- 100.67.0.1                         0.0%    10    3.3   3.1   2.5   3.6   0.4
  4.|-- ae8.fcr01j.tls1.myaisfibre.com     0.0%    10   11.8  13.3  11.8  19.8   2.4
  5.|-- ve474.cgn05.tls1.myaisfibre.com    0.0%    10   11.6  12.1  11.5  12.7   0.4
  6.|-- ae23.bgw01j.tls1.myaisfibre.com    0.0%    10   13.0  12.7  12.2  13.3   0.3
  7.|-- 49-228-5-0.24.tls1.myaisfibre.com 70.0%    10   12.4  12.5  12.4  12.8   0.3
  8.|-- ???                               100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- 119.31.4.124                       0.0%    10   38.9  39.1  38.7  39.5   0.3
 10.|-- 151.101.65.91                      0.0%    10   14.6  14.3  13.7  14.7   0.3

[nix-shell:~]# mtr -6 --report-wide cache.nixos.org
Start: 2026-03-07T13:33:58+0000
HOST: bam                                                Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- GL-MT3000.lan                                       0.0%    10    1.0   0.7   0.5   1.0   0.2
  2.|-- 2405-9800-b900.44.pool1.cmbp-mser01.myaisfibre.com  0.0%    10    1.6   1.4   1.2   1.6   0.1
  3.|-- 2405:9800:70::5                                     0.0%    10    5.3   3.1   2.5   5.3   0.8
  4.|-- 2405:9800:b005:96::97                               0.0%    10   12.1  14.3  11.8  23.0   4.0
  5.|-- 2405:9800:b005:100::100                             0.0%    10   12.9  12.7  12.2  13.7   0.4
  6.|-- 2405:9800:b005:118::118                             0.0%    10   12.3  12.2  11.8  12.9   0.4
  7.|-- 2405:9800:9802::32e                                 0.0%    10   14.7  15.0  14.5  15.5   0.3
  8.|-- 2405:9800:9802::31d                                 0.0%    10   39.4  39.7  39.0  40.2   0.3
  9.|-- 2a04:4e42:400::347                                  0.0%    10   15.0  14.6  13.6  15.1   0.5

hexa (signing key rotation when)

13:34:36
@hexa:lossy.networkhexa (signing key rotation when)that looks like a local pop, but if that one is slow then redistribution within fastlys network is the culprit13:36:10
@lt1379:matrix.orgLunCan I get restart jobs perms on hydra?15:37:38
@hexa:lossy.networkhexa (signing key rotation when)Yes, what is your hydra account?15:45:30
@lt1379:matrix.orgLungit@lunnova.dev15:50:51
@hexa:lossy.networkhexa (signing key rotation when)done15:59:01
@lt1379:matrix.orgLunthanks!15:59:18
8 Mar 2026
@hsngrmpf:matrix.orgDavHauOK, is there anything we can do? Can we escalate this issue to fastly?05:24:13
@k900:0upti.meK900staging-nixos merged, kconfig builder complained about, all channels booped10:00:18
@k900:0upti.meK900Me tired10:01:17
@eveeifyeve:matrix.orgeveeifyeveA good tip, sometimes you need to take it easy on yourself..12:32:40
@eveeifyeve:matrix.orgeveeifyeve* A good tip, sometimes you need to take it easy on yourself and take a break.12:33:05
@hexa:lossy.networkhexa (signing key rotation when) you can open a ticket with fastly here https://support.fastly.com/s/contactsupport 13:23:58
@hexa:lossy.networkhexa (signing key rotation when)this is better than us opening one, since you can collect the details and reproduce the issue13:24:26
@ss:someonex.netSomeoneSerge (matrix works sometimes) changed their display name from SomeoneSerge (back on matrix) to SomeoneSerge (matrix works sometimes).23:34:24

There are no newer messages yet.


Back to Room ListRoom Version: 6