!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

482 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.149 Servers

Load older messages


SenderMessageTime
24 Jun 2026
@vcunat:matrix.orgVladimír Čunátpytest I suspect13:47:58
@hexa:lossy.networkhexascikit-bio is my guess13:48:16
@vcunat:matrix.orgVladimír ČunátI mean, all the culprits seem to be running pytest tests right now.13:48:37
@vcunat:matrix.orgVladimír ČunátSo perhaps it's what pytest does in usual setups?13:49:07
@hexa:lossy.networkhexayeah, but some are doing openmp13:49:11
@hexa:lossy.networkhexapytest-xdist in nixpkgs respects NIX_BUILD_CORES13:49:27
@hexa:lossy.networkhexaalso, how is this anything new?13:49:44
@hexa:lossy.networkhexawe still schedule the same max number to elated-minsky as before13:49:51
@k900:0upti.meK900I don't think it is13:49:55
@hexa:lossy.networkhexabut now we stop after cpu some exceeds 70% :)13:49:59
@k900:0upti.meK900We're just seeing more occupancy than before13:50:01
@k900:0upti.meK900So we hit that more often13:50:07
@hexa:lossy.networkhexaI think we need to fix some packages in response13:50:14
@hexa:lossy.networkhexafind out how to limit libgomp parallelism during tests13:50:27
@hexa:lossy.networkhexa
  53.40%  libgomp.so.1.0.0                                   [.] gomp_team_barrier_wait_end
  42.08%  libgomp.so.1.0.0                                   [.] gomp_barrier_wait_end
   3.01%  libopenblas.so.0.3                                 [.] inner_thread
   0.28%  libopenblas.so.0.3                                 [.] inner_thread
   0.19%  libopenblas.so.0.3                                 [.] inner_thread
   0.14%  .perf-wrapped                                      [.] queue_event
   0.03%  .perf-wrapped                                      [.] perf_sample__init
   0.03%  libc.so.6                                          [.] _int_malloc
   0.02%  .perf-wrapped                                      [.] hist_entry__cmp_impl.constprop.2
   0.02%  .perf-wrapped                                      [.] evlist__event2evsel
   0.02%  libopenblas.so.0.3                                 [.] inner_thread
13:51:03
@vcunat:matrix.orgVladimír ČunátI agree it does not look related to the new queue-runner.13:51:19
@hexa:lossy.networkhexasomething OMP_NUM_THREADS13:51:33
@hexa:lossy.networkhexaalso I noticed that nodejs is not marked big-parallel13:52:26
@hexa:lossy.networkhexaI'm retry to repro scikit-bio now13:52:58
@vcunat:matrix.orgVladimír ČunátNested parallelism is hard.13:53:23
@hexa:lossy.networkhexapatching libgomp to respect NIX_BUILD_CORES? 🤔13:53:59
@vcunat:matrix.orgVladimír ČunátWe have jobs, then make-level parallelism or equivalent and underneath you might have OpenMP.13:53:59
@vcunat:matrix.orgVladimír ČunátYou can still get a square of what you wanted.13:54:17
@hexa:lossy.networkhexabut openmp cores are on top of the actual build cores already13:54:19
@vcunat:matrix.orgVladimír Čunát I mean, for elated-minsky in particular, 2^2 isn't bad, so at least some improvement. 13:54:50
@hexa:lossy.networkhexaoh, yeah13:56:59
@hexa:lossy.networkhexahere we are. 64 threads at 83% test progress13:57:10
@hexa:lossy.networkhexahttps://github.com/NixOS/nixpkgs/pull/53496114:09:35
@hexa:lossy.networkhexapropagatedPreCheck when14:09:58
@hexa:lossy.networkhexamace-torch is another omp consumer14:27:05

Show newer messages


Back to Room ListRoom Version: 6