!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

373 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.113 Servers

Load older messages


SenderMessageTime
22 Jul 2025
@hexa:lossy.networkhexa (signing key rotation when)* given that you are presumably sitting in brussels, but handing off the traffic to british telecom13:03:53
@drupol:matrix.org@drupol:matrix.orgIs there anything else I could do to try to spot where the issue comes from?13:04:00
@hexa:lossy.networkhexa (signing key rotation when)this really looks like the reverse path from fastly to your AS is broken13:04:16
@hexa:lossy.networkhexa (signing key rotation when)the solution is … peer with fastly somewhere and cut out the middleman13:04:42
@drupol:matrix.org@drupol:matrix.orgWhat worries me is this: the behaviour is strange: downloading just 30 MB takes around 15 minutes. It seems to follow a repeating pattern: the connection works normally for 1–2 seconds, then pauses for about 30 seconds, and this cycle continues indefinitely until the end. 13:04:52
@hexa:lossy.networkhexa (signing key rotation when)yeah, a route can flap13:05:15
@drupol:matrix.org@drupol:matrix.org

peer with fastly somewhere and cut out the middleman

how can I do that?

13:05:43
@hexa:lossy.networkhexa (signing key rotation when)https://bgp.tools/prefix/147.67.128.0/17#connectivity13:05:48
@hexa:lossy.networkhexa (signing key rotation when)single homed behind vodafone 🫠13:05:56
@hexa:lossy.networkhexa (signing key rotation when)if you're not at any exchange you likely cannot13:06:48
@drupol:matrix.org@drupol:matrix.orgI guess the network here is quite protected indeed.13:07:15
@drupol:matrix.org@drupol:matrix.organyway, thanks for the help and the link I'll keep it :)13:09:12
@federicodschonborn:matrix.org@federicodschonborn:matrix.org changed their display name from The Worm 🏳️‍🌈 (he/they) to Wormy McWormface 🏳️‍🌈 (he/they).18:27:19
@solidhal:matrix.orgsolideva (now @ev4:ev4.me) joined the room.20:41:27
23 Jul 2025
@vcunat:matrix.orgvcunat

In the past couple hours we get lots of

mimas hydra-queue-runner[1040202]: AWS error '' (curlCode: 28, Timeout was reached; request id: ), will retry in NN ms

I see nothing at https://health.aws.amazon.com/health/status

10:28:29
@vcunat:matrix.orgvcunatHmm, we only fit less than two days of log for that unit, so who knows how rare this is over long term, but the build throughput does seem unusually low in the past couple hours (which is why I was looking at logs).10:31:15
@vcunat:matrix.orgvcunat *

In the past couple hours we get thousands of

mimas hydra-queue-runner[1040202]: AWS error '' (curlCode: 28, Timeout was reached; request id: ), will retry in NN ms

I see nothing at https://health.aws.amazon.com/health/status

10:32:16
24 Jul 2025
@joerg:thalheim.ioMic92 hexa (signing key rotation when) are we on jitsi or something else today? 16:04:51
@hexa:lossy.networkhexa (signing key rotation when)https://meet.cccda.de/zqb-dylq-bcp16:05:49
@jfly:matrix.orgJeremy Fleischman (jfly)we're there now16:08:28
@maxcf:matrix.orgMax joined the room.16:08:43
@hexa:lossy.networkhexa (signing key rotation when)thanks!16:40:30
25 Jul 2025
@federicodschonborn:matrix.org@federicodschonborn:matrix.org changed their display name from Wormy McWormface 🏳️‍🌈 (he/they) to Cat McFishface 🏳️‍🌈 (he/they).01:44:09
@rnhmjoj:eurofusion.eu@rnhmjoj:eurofusion.eu left the room.14:24:03
26 Jul 2025
@oak:universumi.fioak 🏳️‍🌈♥️ changed their profile picture.08:26:58
@k900:0upti.meK900Can someone take a look at what the channel scripts are doing18:54:33
@k900:0upti.meK900It's been running update-nixos-unstable-small for 15 minutes18:54:40
@vcunat:matrix.orgvcunatIt takes a while, apparently.18:56:50
@vcunat:matrix.orgvcunatI see no errors in there.18:56:54
@vcunat:matrix.orgvcunatRunning for 20 so far.18:57:24

Show newer messages


Back to Room ListRoom Version: 6