!zghijEASpYQWYFzriI:nixos.org

Hydra

376 Members
109 Servers

Load older messages


SenderMessageTime
15 Oct 2023
@k900:0upti.meK900Well, kinda11:56:12
@k900:0upti.meK900But we don't need it on the hot path 11:56:17
@janne.hess:helsinki-systems.dedas_j
In reply to @k900:0upti.me
We can just shove it all into Redis or something
But who will do that
16:27:04
@k900:0upti.meK900Like, who will actually write the code?16:27:28
@k900:0upti.meK900Or what part of Hydra will do that thing16:27:35
@janne.hess:helsinki-systems.dedas_j
In reply to @k900:0upti.me
Like, who will actually write the code?
Yes
16:27:53
@k900:0upti.meK900Yeah that's kind of the problem with everything16:28:07
@ctheune:matrix.flyingcircus.ioChristian Theune Apart from performance i would (ftom my perspective) focus rather on robustness. I am sure som current issues might just be craft issues. 17:43:35
@ctheune:matrix.flyingcircus.ioChristian Theune* Apart from performance i would (from my perspective) focus rather on robustness. I am sure some current issues might just be craft issues.17:43:59
@vcunat:matrix.orgvcunat
In reply to @k900:0upti.me
Yeah that's kind of the problem with everything
Especially with proposals like rewrite from scratch to make it better (ideally in a different language).
17:48:55
@raitobezarius:matrix.orgraitobezarius
In reply to @woobilicious:matrix.org
That's a surprising take since rust seems like it was designed to do more low level, manual management of memory safely. While we just want to interact with some high level stuff like S3 and github, website? you'd get a long way with Haskell web framework and a little abstraction, without having to think too much about it, especially since it' has a real runtime with garbage collection & green threads. I do agree however with the pragmatic stuff like C-FFI, code reuse and accessibility.
What you are probably missing in the discussion is that we also need people to understand and read the code, so we use a Haskell web framework, who are the people who are committing to work on this and teach people on how to work on this? I don't believe it's a good strategy from a maintenance standpoint, we are trying to get out of Perl, I don't think going into Haskell will do any good
23:41:58
@raitobezarius:matrix.orgraitobezariusAnd I+1 the discussion on who will do that23:42:39
@raitobezarius:matrix.orgraitobezarius And I think the key to "who will do that" is to not rewrite from scratch to make it better and reuse the existing stuff and rewrite it slowly while being compatible to make it easier to hack on, which is usually a task that people doesn't like to do but is unfortunately necessary 23:43:06
@raitobezarius:matrix.orgraitobezarius Rust is probably a programming language that Nix community is close to, which can handle the web workload, has sane things in a lot of areas and we can interop with Nix quite easily with it given the current advances on the C FFI 23:44:00
@raitobezarius:matrix.orgraitobezariusI also don't care if this is Python23:44:08
16 Oct 2023
@hacker1024:matrix.orghacker1024Is there a way to increase build timeouts globally? Our build server emulates x86_64 on AArch64 and large packages like OpenCV with CUDA can take around two days to build. It'd be great if there was a way to tell Hydra to scale up timeouts by 3x.22:40:33
@hacker1024:matrix.orghacker1024

The first thing that comes to mind is something like this

pkgs.hydra_unstable.overrideAttrs ({ postPatch ? "", ... }: {
  postPatch = postPatch + ''
    substituteInPlace src/hydra-eval-jobs/hydra-eval-jobs.cc \
        --replace 'queryMetaInt("timeout", 36000)' 'queryMetaInt("timeout", 108000)' \
        --replace 'queryMetaInt("maxSilent", 7200)' 'queryMetaInt("maxSilent", 21600)'
  '';
});
23:01:23
@hacker1024:matrix.orghacker1024 *

The first thing that comes to mind is something like this

pkgs.hydra_unstable.overrideAttrs ({ postPatch ? "", ... }: {
  postPatch = postPatch + ''
    substituteInPlace src/hydra-eval-jobs/hydra-eval-jobs.cc \
        --replace 'queryMetaInt("timeout", 36000)' 'queryMetaInt("timeout", 108000)' \
        --replace 'queryMetaInt("maxSilent", 7200)' 'queryMetaInt("maxSilent", 21600)'
  '';
});
23:01:32
17 Oct 2023
@vcunat:matrix.orgvcunatIn some use cases it might be easy to add meta attributes everywhere on the nix side.10:39:48
@vcunat:matrix.orgvcunat Say, if we modified stdenv.mkDerivation in nixpkgs, it would cover basically all the builds, but there are other ways, too. 10:41:13
@vcunat:matrix.orgvcunat * Say, if we modified stdenv.mkDerivation in nixpkgs, it would cover basically all the builds, but there are other nix-expression ways, too. 10:41:30
@adam:robins.wtf@adam:robins.wtf joined the room.13:17:23
@adam:robins.wtf@adam:robins.wtf left the room.13:19:44
@camocatx:matrix.orgcamocatx joined the room.21:51:26
19 Oct 2023
@hacker1024:matrix.orghacker1024
In reply to @vcunat:matrix.org
In some use cases it might be easy to add meta attributes everywhere on the nix side.
Yep, but I don't want this to apply to any Hydra instance - just our slow one.
22:53:05
21 Oct 2023
@magic_rb:matrix.redalder.orgmagic_rb did hydra get the feature where i could --reference-lock-file? or still not 14:37:02
@magic_rb:matrix.redalder.orgmagic_rbanswering for myself, no it didnt14:46:57
@swendel:curious.bio@swendel:curious.bio joined the room.14:49:03
22 Oct 2023
@globin:toznenetl.chatglobin joined the room.20:01:29
23 Oct 2023
@robin.gloster:matrix.mayflower.deglobin left the room.09:50:17

Show newer messages


Back to Room ListRoom Version: 6