!lymvtcwDJ7ZA9Npq:lix.systems

Lix Development

431 Members
(Technical) development of Lix, the package manager, a Nix implementation. Please be mindful of ongoing technical conversations in this channel.141 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
10 Dec 2025
@piegames:flausch.socialpiegamesthat too, but that's not even what I meant17:18:20
@kfears:matrix.orgKFears& šŸ³ļøā€āš§ļø (they/them)
In reply to @piegames:flausch.social
Due to unfortunate design decisions made (or rather, not made) back when I was in Kindergarten, parsing is on the critical path for evaluation time
Is that because parsing is so unbearably slow, or is there a more cursed reason?
17:18:25
@qyriad:katesiria.orgQyriad
In reply to @piegames:flausch.social
Due to unfortunate design decisions made (or rather, not made) back when I was in Kindergarten, parsing is on the critical path for evaluation time
we would like to see benchmarks on this… we'd honestly sooner suspect filesystem IO as a bottleneck over parse-time
17:18:48
@qyriad:katesiria.orgQyriad
In reply to @piegames:flausch.social
Due to unfortunate design decisions made (or rather, not made) back when I was in Kindergarten, parsing is on the critical path for evaluation time
* we would like to see benchmarks/profiles on this… we'd honestly sooner suspect filesystem IO as a bottleneck over parse-time
17:19:17
@qyriad:katesiria.orgQyriad (having looked at profiles of eval before, but not in a while) 17:19:29
@piegames:flausch.socialpiegamesno, parsing is super fast, mostly thanks to horrors, it's just that Nixpkgs is 3.6MLOC over 40k files and every single NixOS eval loads a good chunk of that, realistically multiple times. The main issue is that caching was never a thought in the architecture and adding it afterwards is really tricky17:21:27
@qyriad:katesiria.orgQyriad don't forget that every single Nixpkgs package loads hundreds if not thousands of other nix files 17:22:24
@piegames:flausch.socialpiegames yes, we're close enough to that atm, there still is one full AST walk for bindVars that's still costly (I tried to remove it with horrors but unexplicably did not make anything faster) and general AST allocation cost (more bump allocators would help a lot there probably) 17:22:40
@qyriad:katesiria.orgQyriad
In reply to @qyriad:katesiria.org
don't forget that every single Nixpkgs package loads hundreds if not thousands of other nix files
(and instantiates half a gazillion derivations…)
17:22:52
@piegames:flausch.socialpiegames we won't get much faster than that (though I expect that a parse that can directly emit Bytecode should be a little bit faster still because more compact representation), but the Rust rewrite still needs to be at least as fast as now and that's no small feat 17:23:20
@piegames:flausch.socialpiegames * we won't get much faster than that (though I expect that a parser that can directly emit Bytecode should be a little bit faster still because more compact representation), but the Rust rewrite still needs to be at least as fast as now and that's no small feat 17:23:45
@commentator2.0:elia.gardenlegacy_rootile -> @rootile:flausch.social
In reply to @piegames:flausch.social
we won't get much faster than that (though I expect that a parser that can directly emit Bytecode should be a little bit faster still because more compact representation), but the Rust rewrite still needs to be at least as fast as now and that's no small feat
Could the rust version be possibly be writtten with cache in mind from the beginning?
17:25:15
@piegames:flausch.socialpiegamesyes, but the issue is, what is your cache key?17:25:37

Show newer messages


Back to Room ListRoom Version: 10