!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

389 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.121 Servers

Load older messages


SenderMessageTime
3 Sep 2021
@domenkozar:matrix.orgDomen Kožarabout bootstrapping a business .. yeah 3 years in it's still hard :D15:35:55
@grahamc:nixos.org@grahamc:nixos.orghey 3 years is supposed to be that magic number of "if you made it this long you've probably got something"15:36:50
@vcunat:matrix.orgVladimír Čunátsome debt at least15:38:17
@domenkozar:matrix.orgDomen Kožar:D15:40:45
@domenkozar:matrix.orgDomen KožarI mean given how crazy the dev market is these days it's a huge opportunity cost15:41:04
@domenkozar:matrix.orgDomen Kožarbut I'm lucky to be a cheap fuck so whatever, I prefer to improve Nix :)15:41:30
@grahamc:nixos.org@grahamc:nixos.orgyeah, I could make way more money if I went and got a regular job15:42:12
@grahamc:nixos.org@grahamc:nixos.orglol15:42:14
@grahamc:nixos.org@grahamc:nixos.organd have way less stress 15:42:19
@domenkozar:matrix.orgDomen Kožarespecially at the moment, everyone is hiring15:44:57
@grahamc:nixos.org@grahamc:nixos.orgmaybe I should go find a real job ...15:48:30
@domenkozar:matrix.orgDomen Kožarnah15:52:12
@domenkozar:matrix.orgDomen Kožarwe need more businesses in Nix pushing things forward :)15:53:30
@grahamc:nixos.org@grahamc:nixos.orgyeah :) I think this thing will work out okay 15:54:03
@vcunat:matrix.orgVladimír Čunát
In reply to @grahamc:nixos.org
that can happen if Equinix is takingor replacing spot instances, between the moments of our automationrefreshing keys and builders
Seems to happen quite often: https://hydra.nixos.org/build/151898830#tabs-buildsteps
16:54:05
@grahamc:nixos.org@grahamc:nixos.orgsometimes they do a lot of shuffling around on their spot market16:54:51
@vcunat:matrix.orgVladimír ČunátToo bad for builds that take many hours.16:55:06
@grahamc:nixos.org@grahamc:nixos.orgwell, I'm not sure those are related16:55:16
@grahamc:nixos.org@grahamc:nixos.orgthe ones I'm referring to are the no host / ssh host key change errors16:55:50
@vcunat:matrix.orgVladimír ČunátAh, OK, I meant the end-of-file abortions.16:56:12
@grahamc:nixos.org@grahamc:nixos.orgof course it is possible those end-of-file are coming from a machine that was taken away from us16:56:13
@grahamc:nixos.org@grahamc:nixos.orgwe can look in to that and find out, one sec16:56:27
@grahamc:nixos.org@grahamc:nixos.orgs/one sec/10 min/ (finishing lunch)16:56:45
@vcunat:matrix.orgVladimír ČunátIf I count attempts on this particular chromium output path that took at least some minutes, it would be at least five of them.16:58:54
@vcunat:matrix.orgVladimír ČunátIt seems quite a wasted, and apparently I have to restart the stuff manually as well.16:59:29
@vcunat:matrix.orgVladimír Čunát * It seems quite a waste, and apparently I have to restart the stuff manually as well.16:59:35
@grahamc:nixos.org@grahamc:nixos.orghttps://monitoring.nixos.org/prometheus/graph?g0.expr=up%7Binstance%3D%22546ef6b6.packethost.net%22%7D&g0.tab=0&g0.stacked=0&g0.range_input=1w17:00:40
@grahamc:nixos.org@grahamc:nixos.org taking a look at this one machine's up status over the past week indicates that indeed it booted, lived for about 25 minutes, and then terminated 17:01:13
@grahamc:nixos.org@grahamc:nixos.orgit looks like their spot market is churning indeed17:03:39
@vcunat:matrix.orgVladimír ČunátMaybe I'd prefer scheduling big-parallel builds to machines that seem likely to live longer. Assuming this is a common situation and we can tell in advance if it might happen.17:03:54

Show newer messages


Back to Room ListRoom Version: 6