!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

385 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.120 Servers

Load older messages


SenderMessageTime
19 Sep 2025
@dgrig:erethon.comdgrighttps://anubis.techaro.lol/blog/2025/cpu-core-odd/20:25:13
@ghpzin:envs.netghpzin Commit with fix seems to be only in v1.22.0:
https://github.com/TecharoHQ/anubis/commit/c661bc37d133976a005fb0b1060e3e0a34f69003
20:28:20
21 Sep 2025
@hexa:lossy.networkhexagetting closer to replacing haumea21:25:36
@hexa:lossy.networkhexabut the requirements changed slightly21:25:47
@hexa:lossy.networkhexagiven the recent increase of low disk alerts we should go for 2x2TB instead of 2x1TB21:26:03
@hexa:lossy.networkhexaupgrading an AX52 will land us at 124,63 EUR/mo21:27:05
@hexa:lossy.networkhexaan AX102 starts at 125,84 EUR/mo and comes with twice the memory and a beefier CPU21:27:43
@hexa:lossy.networkhexathe intel alternative would be an EX101 but I'm not fond of the prevalence of E-cores on the i9-1390021:28:18
@hexa:lossy.networkhexahttps://www.hetzner.com/dedicated-rootserver/matrix-ax/ https://www.hetzner.com/dedicated-rootserver/matrix-ex/21:28:34
@hexa:lossy.networkhexathough the intel machine does come with ECC memory and 2x2TB disk 😬21:29:49
@hexa:lossy.networkhexaanyway, these are my thoughts. enjoy21:30:58
@dgrig:erethon.comdgrig ECC would be good to have, but I wonder if those intel 13900s are affected by this or did Hetzner RMA'd them/patched them all fast enough 21:35:57
@hexa:lossy.networkhexasupposedly fixed by firmware updates a while ago21:37:17
@nico:c3d2.deNico joined the room.21:42:45
@tom:dragar.deTomI think you'll end up paying and receiving (if you don't tell them to remove those) the default two 1tb drives anyway. So if you add 2x 1tb you're getting 1 TB, 1 TB, 2 TB and 2 TB. Just mentioning it in case that wasn't considered and somehow affects the plans.21:45:14
@hexa:lossy.networkhexayeah, I'm aware.21:45:53
@hexa:lossy.networkhexa

ECC would be good to have

ECC has been doing its thing on haumea for a few months, so we're not going to give that up

22:33:24
@hexa:lossy.networkhexathe primary reason we're making a move22:33:47
@hexa:lossy.networkhexa
MCE records summary:
	9168 Corrected error, no action required. errors
22:34:00
@hexa:lossy.networkhexa *
Memory controller events summary:
	Corrected on DIMM Label(s): 'mc#0csrow#1channel#0' location: 0:1:0:-1 errors: 4973

MCE records summary:
	9168 Corrected error, no action required. errors
22:34:20
22 Sep 2025
@felix.schroeter:scs.ems.host@felix.schroeter:scs.ems.host changed their display name from Felix Schröter to Felix Schröter (🌄 29.09. – 05.10.).09:55:59
@vcunat:matrix.orgVladimír ČunátSome Hydra metrics are gone now: https://grafana.nixos.org/d/MJw9PcAiz/hydra-jobs16:09:52
@vcunat:matrix.orgVladimír ČunátI think I saw them working less than 24h ago.16:11:08
@ghpzin:envs.netghpzin instance label changed, so dashboard shows nothingjm 16:18:44
@ghpzin:envs.netghpzin instance label changed, so dashboard shows nothing, metrics seem to be still there 16:19:05
@ghpzin:envs.netghpzin instance label changed, so dashboard shows nothing:
https://grafana.nixos.org/goto/DdQG9uCNg?orgId=1
16:25:43
@ghpzin:envs.netghpzin instance label changed from monitoring.nixos.org:9200 to localhost:9200, so dashboard shows nothing:
https://grafana.nixos.org/goto/DdQG9uCNg?orgId=1
https://github.com/NixOS/infra/commit/0ebab0affe655b6a278843124a10637c50e6e78d#diff-7dbeda5809ed539867d6bc0ec13abd3ecfd987097db6c868533588c2e36b3d82L54
16:48:41
@hexa:lossy.networkhexayeah, was fairly pointless to expose the metric externally17:08:37
@hexa:lossy.networkhexaunclear why grafana shows no result, but with prometheus I see the metric17:12:13
@hexa:lossy.networkhexahttps://prometheus.nixos.org/query?g0.expr=hydra_steps_queued&g0.show_tree=0&g0.tab=table&g0.range_input=1h&g0.res_type=auto&g0.res_density=medium&g0.display_mode=lines&g0.show_exemplars=017:12:20

Show newer messages


Back to Room ListRoom Version: 6