!9IQChSjwSHXPPWTa:lix.systems

Lix

627 Members
Lix user channel. Feel free to discuss on-topic issues here and give each other help. For matrix.to links to the rest of the Lix channels, see: https://wiki.lix.systems/books/lix-organisation/page/matrix-rooms196 Servers

Load older messages


SenderMessageTime
11 Oct 2024
@jakehamilton:auxolotl.orgjakehamilton
In reply to @k900:0upti.me
nix-eval-jobs is not multithreaded inside a single eval
I see, that tracks with what my gut was telling me. Thank you for the clarification!
14:55:50
@rosscomputerguy:matrix.orgTristan RossI've benchmarked the multithreaded evaluator quite a bit between single core and 64 cores, at some point, the performance degrades because it seems there's just not enough jobs available for the limit.15:04:32
@rosscomputerguy:matrix.orgTristan RossIt's kinda interesting because with a nix flake check, it seems to depend on the number of attributes on the outputs attr set15:05:18
@aloisw:kde.orgaloiswDon't they only evaluate different outputs in parallel?16:04:17
@kfears:matrix.orgKFears (tragedy arc)
In reply to @k900:0upti.me
Generally I don't think it's really a good solution because we don't even know what the bottlenecks are most of the time
Really handy that OTLP is interested in merging profiling:
https://github.com/open-telemetry/oteps/blob/main/text/profiles/0239-profiles-data-model.md
16:14:10
@kfears:matrix.orgKFears (tragedy arc)https://github.com/open-telemetry/opentelemetry-cpp/issues/265716:19:19
@k900:0upti.meK900Yeah probably won't help us much, the real problem is mapping evaluator spans back to Nix code 16:20:39
@kfears:matrix.orgKFears (tragedy arc)Grafana Pyroscope has profiles-to-traces, which can help a bit16:23:00
@kfears:matrix.orgKFears (tragedy arc)But it's a hard problem with solutions that didn't even hit bleeding edge yet, for sure16:23:27
@kfears:matrix.orgKFears (tragedy arc)I wonder if it's possible to get NixLang to support OTLP tracing. Would be possible to track spans across Nix/C++ boundary...16:29:40
12 Oct 2024
@kevintran:matrix.orgKevin Tran joined the room.00:11:47
@kevintran:matrix.orgKevin TranDownload 8nmaa2n1msjbik2cdwdknmyz26jk2iwl-lix-2.91.0.txt00:13:44
@kevintran:matrix.orgKevin Trani was update my flake.lock and rebuilding with darwin-rebuild, when i got this error message. i am running macos sequoia00:13:59
@federicodschonborn:matrix.orgFederico Damián Schonborn changed their profile picture.00:30:56
@rosscomputerguy:matrix.orgTristan Ross
In reply to @aloisw:kde.org
Don't they only evaluate different outputs in parallel?
Yeah, each output takes a job which I think is where this sort of causes the performance degradation after a certain number of cores being made available.
02:05:15
@julia:the-apothecary.clubjuliaI mean also my understanding is the implementation was just mutexes everywhere... (... a custom implementation for the quoted reason of not wanting to use mutexes, except they reimplemented the whole worker thread waiting but in userspace)02:44:15
@julia:the-apothecary.clubjulia* I mean also my understanding is the implementation was just mutexes everywhere... (... a custom implementation for the quoted reason of not wanting to use mutexes, except they reimplemented the whole worker thread waiting but in userspace and used CAS i.e. mutex)02:45:22
@k900:0upti.meK900It's a new, uniquely cursed form of synchronization primitive06:34:05
@k900:0upti.meK900An eetex06:34:08
@aloisw:kde.orgaloiswCustom mutex implemented using mutexes, to be precise.07:56:02
@eida:techniverse.net@eida:techniverse.net joined the room.08:46:08
@eida:techniverse.net@eida:techniverse.net left the room.08:51:28
@uep:matrix.orguepwhy has noone invented the µtex10:09:41
@antifuchs:asf.computerantifuchs
In reply to @k900:0upti.me
An eetex
The small, less threatening variant would be the moo-dengtex?
12:04:08
@kfears:matrix.orgKFears (tragedy arc)DetSystex12:23:02
@qbit:tapenet.orgqbittrying to get my darwin-aarch64 machine over the nix->lix bump14:08:27
@qbit:tapenet.orgqbitoh hrm: nix (Nix) 2.18.414:08:54
@qbit:tapenet.orgqbitoh, maybe my machine isn’t using the module..14:09:41
@qbit:tapenet.orgqbit

k, added it to the modules, but when I try to do darwin-rebuild switch —flake github:qbit/xin —refresh i get:

building the system configuration...
error:
… while setting up the build environment

   error: getting attributes of path '/private/tmp/nix-build-builder.pl.drv-0/build: Permission denied
14:15:58
@qbit:tapenet.orgqbitguess i’ll try as root :P14:16:23

Show newer messages


Back to Room ListRoom Version: 10