!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

373 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.114 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
22 Sep 2025
@felix.schroeter:scs.ems.host@felix.schroeter:scs.ems.host changed their display name from Felix Schröter to Felix Schröter (🌄 29.09. – 05.10.).09:55:59
@vcunat:matrix.orgvcunatSome Hydra metrics are gone now: https://grafana.nixos.org/d/MJw9PcAiz/hydra-jobs16:09:52
@vcunat:matrix.orgvcunatI think I saw them working less than 24h ago.16:11:08
@ghpzin:envs.netghpzin instance label changed, so dashboard shows nothingjm 16:18:44
@ghpzin:envs.netghpzin instance label changed, so dashboard shows nothing, metrics seem to be still there 16:19:05
@ghpzin:envs.netghpzin instance label changed, so dashboard shows nothing:
https://grafana.nixos.org/goto/DdQG9uCNg?orgId=1
16:25:43
@ghpzin:envs.netghpzin instance label changed from monitoring.nixos.org:9200 to localhost:9200, so dashboard shows nothing:
https://grafana.nixos.org/goto/DdQG9uCNg?orgId=1
https://github.com/NixOS/infra/commit/0ebab0affe655b6a278843124a10637c50e6e78d#diff-7dbeda5809ed539867d6bc0ec13abd3ecfd987097db6c868533588c2e36b3d82L54
16:48:41
@hexa:lossy.networkhexa (signing key rotation when)yeah, was fairly pointless to expose the metric externally17:08:37
@hexa:lossy.networkhexa (signing key rotation when)unclear why grafana shows no result, but with prometheus I see the metric17:12:13
@hexa:lossy.networkhexa (signing key rotation when)https://prometheus.nixos.org/query?g0.expr=hydra_steps_queued&g0.show_tree=0&g0.tab=table&g0.range_input=1h&g0.res_type=auto&g0.res_density=medium&g0.display_mode=lines&g0.show_exemplars=017:12:20
@ghpzin:envs.netghpzin Metrics are still there, dashboard hardcodes instance="monitoring.nixos.org:9200" 17:15:55
@vcunat:matrix.orgvcunatI think I fixed the graphs now.17:16:37
@vcunat:matrix.orgvcunatJust edited the dashboard.17:17:02
@sternenseemann:systemli.orgsterni Do any (Darwin) builders use Nix 2.30 already? We've noticed the interesting problem that the new build-dir location causes longer paths which can relatively easily cause failures becasue unix socket paths are quite restricted on macOS apparently. (Observed with `haskellPackages.network.) 19:50:07
@emilazy:matrix.orgemilyIIRC this was mitigated in the latest patch release19:50:54
@emilazy:matrix.orgemilywith possible further changes to come19:51:07
@emilazy:matrix.orgemily(the limits are similarly strict on Linux btw, just the sandbox helps there)19:51:21
@hexa:lossy.networkhexa (signing key rotation when)no, they track nixos-stable19:51:33
@hexa:lossy.networkhexa (signing key rotation when)* no, they track nixpkgs-stable19:51:36
@sternenseemann:systemli.orgsternihttps://github.com/NixOS/nix/pull/13839?19:51:40
@hexa:lossy.networkhexa (signing key rotation when)so 2.28ish19:51:41
@hexa:lossy.networkhexa (signing key rotation when)but we're aware of the issue19:51:48
@emilazy:matrix.orgemilyyeah19:54:13
@emilazy:matrix.orgemily another option for Hydra is just a custom build-dir, but I think shouldn't be necessary 19:54:26
@emilazy:matrix.orgemily(pls no workarounds in Nixpkgs, it affects like a billion packages)19:54:46
@sternenseemann:systemli.orgsternithat's the last thing I want to spend my time with :p19:56:27

Show newer messages


Back to Room ListRoom Version: 6