!zghijEASpYQWYFzriI:nixos.org

Hydra

388 Members
112 Servers

Load older messages


SenderMessageTime
14 Feb 2022
@grahamc:nixos.org@grahamc:nixos.orgnice14:15:18
@grahamc:nixos.org@grahamc:nixos.orgI'm hoping we could add a proper exporter directly to the evaluator and queue runner some day, but this looks great14:15:37
@janne.hess:helsinki-systems.dedas_jyeah I was hoping the evaluator somehow dumps its state into the db as well but I couldn't find anything14:16:19
@grahamc:nixos.org@grahamc:nixos.orgone tricky bit of that is of course the process breakdown of hydra-evaulator calling hydra-evaluate-jobset calling hydra-eval-jobs, and potentially each of these could feasibly contain their own exporter, which would also be weird14:27:52
@janne.hess:helsinki-systems.dedas_jWhat about this: The main daemon opens a fd for its subprocesses (FD 5 or something), and the subprocesses write their metrics there, maybe as kv pairs? Would be shitty but better than nothing14:29:04
@janne.hess:helsinki-systems.dedas_jThe main process can then collect these and serve them14:29:27
@grahamc:nixos.org@grahamc:nixos.orgI've tried to do that for ofborg in the past but was sort of a mess14:29:31
@grahamc:nixos.org@grahamc:nixos.orgbut that was quite a bit more complicated 14:29:55
@janne.hess:helsinki-systems.dedas_jor each component just writes its stats into the main db and we scrape from there14:29:59
@grahamc:nixos.org@grahamc:nixos.orgso it could very well work here14:30:00
@pedrohlc:mozilla.org@pedrohlc:mozilla.org joined the room.15:13:45
15 Feb 2022
@packetgrill:automattic.com@packetgrill:automattic.com joined the room.13:32:31
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.de So I'm trying to update the hydra package in nixpkgs, and ran into migrations failing because the pgcrypto postgres extension was missing. Seems odd to me though that this wouldn't have been caught by NixOS tests. Has everyone who runs a hyra done CREATE EXTENSION pgcrypto; manually, or am I missing a place where that's done within hydra (a plain rg pgcrypto on the hydra repo didn't yield any results), or what might be happening here? 16:45:49
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.de * So I'm trying to update the hydra package in nixpkgs, and ran into migrations failing because the pgcrypto postgres extension was missing. Seems odd to me though that this wouldn't have been caught by NixOS tests. Has everyone who runs a Hydra done CREATE EXTENSION pgcrypto; manually, or am I missing a place where that's done within hydra (a plain rg pgcrypto on the hydra repo didn't yield any results), or what might be happening here? 16:45:55
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.de Aah, apparently gen_random_uuid() is built into postgres starting from 13.x 16:49:57
@janne.hess:helsinki-systems.dedas_j
In reply to @linus.heckemann:matrix.mayflower.de
So I'm trying to update the hydra package in nixpkgs, and ran into migrations failing because the pgcrypto postgres extension was missing. Seems odd to me though that this wouldn't have been caught by NixOS tests. Has everyone who runs a Hydra done CREATE EXTENSION pgcrypto; manually, or am I missing a place where that's done within hydra (a plain rg pgcrypto on the hydra repo didn't yield any results), or what might be happening here?
Ah if you're touching it anyway (I know people love when I say that - could you replace --set HYDRA_RELEASE ${version} \ with --set-default HYDRA_RELEASE ${version} \? I don't think it's worth its own PR
16:51:14
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.delol16:51:31
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.deyeah can do that16:51:37
@janne.hess:helsinki-systems.dedas_jthanks ;)16:51:42
@rick:matrix.ciphernetics.nlRick (Mindavi)
In reply to @linus.heckemann:matrix.mayflower.de
So I'm trying to update the hydra package in nixpkgs, and ran into migrations failing because the pgcrypto postgres extension was missing. Seems odd to me though that this wouldn't have been caught by NixOS tests. Has everyone who runs a Hydra done CREATE EXTENSION pgcrypto; manually, or am I missing a place where that's done within hydra (a plain rg pgcrypto on the hydra repo didn't yield any results), or what might be happening here?
Thanks for looking into that.
17:08:44
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.dethanks for starting the work, I picked your commit as a base :)17:09:00
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.de das_j: hm, why exactly should that be --set-default? Changing that to something other than the running package seems weird. 17:14:35
@janne.hess:helsinki-systems.dedas_j
In reply to @linus.heckemann:matrix.mayflower.de
das_j: hm, why exactly should that be --set-default? Changing that to something other than the running package seems weird.
I'm overriding the src of the package locally and the postPatch is not affected by that override
17:15:03
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.deaah fair17:16:20
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.de das_j: Rick (Mindavi): would you care to be maintainers as well? With https://github.com/NixOS/nixpkgs/pull/158948 it doesn't currently have any maintainers. 19:01:50
@janne.hess:helsinki-systems.dedas_j
In reply to @linus.heckemann:matrix.mayflower.de
das_j: Rick (Mindavi): would you care to be maintainers as well? With https://github.com/NixOS/nixpkgs/pull/158948 it doesn't currently have any maintainers.
Yeah why not. Will probably not give me substantially more GH notifications 🤷
19:05:31
@rick:matrix.ciphernetics.nlRick (Mindavi)I'm running it from nixpkgs anyway, so don't mind reviewing now and then19:08:40
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.desweet, so the package goes from 1 to 0 to 3 maintainers :D19:08:43
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.deHm, I've been trying to mix lovesegfault's changes from https://github.com/NixOS/nixpkgs/pull/157072 in as well. Not sure if this is actually something we should do or not though19:27:08
@linus.heckemann:matrix.mayflower.de@linus.heckemann:matrix.mayflower.deI think it does make sense to have a single version of hydra in nixpkgs. And I think the hydra package in nixpkgs is a bit "second-class" given that upstream development and the hno deployment use flakes.19:31:13

Show newer messages


Back to Room ListRoom Version: 6