!djTaTBQyWEPRQxrPTb:nixos.org

Nixpkgs Architecture Team

229 Members
https://github.com/nixpkgs-architecture, weekly public meetings on Wednesday 15:00-16:00 UTC at https://meet.jit.si/nixpkgs-architecture53 Servers

Load older messages


SenderMessageTime
11 Jul 2023
@piegames:matrix.org@piegames:matrix.orgI thought the idea was to have local module system instances for individual packages or groups thereof10:39:01
@profpatsch:augsburg.oneprofpatschthat sounds … even worse?11:12:29
@piegames:matrix.org@piegames:matrix.orgI don't know11:16:56
@piegames:matrix.org@piegames:matrix.org IMO we should rewrite all builders so that there is exactly only one override function (or maybe two for now). Because I'm pretty sure this should be possible 11:18:56
@toonn:matrix.orgtoonn Has any profiling been done? I'd be interested to see which parts of Nixpkgs a typical system build spends most time in. 11:20:30
@raitobezarius:matrix.orgraitobezarius
In reply to @profpatsch:augsburg.one
roberthensing: I don’t think it’s any question
I think you are forgetting you are discussing this with the person who works actively on NixOS modules and has ideas to make it fast…
11:31:33
@profpatsch:augsburg.oneprofpatschraitobezarius: It’s fundamentally impossible to make it fast as far as I understand, but I’d love if it were otherwise12:27:34
@profpatsch:augsburg.oneprofpatsch If you can get it to work without having to strictly evaluate all options first, then you might be able to 12:28:15
@profpatsch:augsburg.oneprofpatschbut then you have something that’s not the nixos module system anymore, because the semantics is different12:28:36
@nbp:mozilla.orgnbpIt would be possible to make NixOS module use less memory and potentially be faster … by implementing it in C++. But one must understand that the module system, while not evolving frequently is still evolving. And from my point of view, of someone who never managed to get anything large accepted in Nix source code, this is a not an option.12:30:54
@infinisil:matrix.orginfinisilIt could be implemented as a Nix plugin12:31:50
@nbp:mozilla.orgnbpNot mentioning the fact that evolution would be restricted to evolution of the Nix binary.12:31:54
@nbp:mozilla.orgnbpCan Nix plugin extend the grammar, to experiment new syntax / primitive?12:34:01
@piegames:matrix.org@piegames:matrix.org
In reply to @infinisil:matrix.org
It could be implemented as a Nix plugin
Are these a thing already? What can they do?
12:42:09
@piegames:matrix.org@piegames:matrix.org
In reply to @nbp:mozilla.org
Can Nix plugin extend the grammar, to experiment new syntax / primitive?
Simply being able to efficiently implement external functions exposed in Nix would probably be sufficient
12:42:47
* @piegames:matrix.org@piegames:matrix.org dreams of a WASM interface to Nix, to be able to implement complex functions efficiently in other languages, without being tied to the Nix code base12:43:36
@nbp:mozilla.orgnbpthe reason I am asking is for S.O.S. implementation.12:43:38
@nbp:mozilla.orgnbp * the reason I am asking is for S.O.S. implementation draft. 12:43:59
@profpatsch:augsburg.oneprofpatschnbp: does SOS fix the strictness problem of merging options?12:58:24
@nbp:mozilla.orgnbpSOS has nothing to do with modules, so no.12:58:45
@nbp:mozilla.orgnbpSOS focuses on replacing all override* by the update operator.12:59:07
@profpatsch:augsburg.oneprofpatschOr rather, does it reduce the power of the module system (modules can depend on each others’ config values recursively and cycic-ly)12:59:15
@profpatsch:augsburg.oneprofpatschbecause that power is the main reason for the slowness12:59:32
@profpatsch:augsburg.oneprofpatschyou can’t expect a global arbitrary fixed-point to be performant, because there’s literally no optimizations you can make12:59:52
@profpatsch:augsburg.oneprofpatschesp if you want the result to be a maximally lazy data structure, which for packages definitely has to be the case13:00:28
@profpatsch:augsburg.oneprofpatschyou can say what you want about callPackage, but laziness it does preserve13:01:00
@nbp:mozilla.orgnbpWhat makes NixOS slow is the delegation of properties. If instead of delegating properties one level at a time, you were to spam all options covered by it … that would reduce the memory and time.13:01:15
@nbp:mozilla.orgnbpThis might actually be doable in Nix …13:01:28
@profpatsch:augsburg.oneprofpatschnbp: what do you mean by “delegation of properties”?13:04:06
@nbp:mozilla.orgnbp mkIf cond { foo = …; } ==> { foo = mkIf cond …; } 13:05:14

Show newer messages


Back to Room ListRoom Version: 9